System and method for delivering a multimedia presentation to a user and to allow the user to play a musical instrument in conjunction with the multimedia presentation

ABSTRACT

Disclosed is a system and method to deliver a multimedia presentation of an audio file to a computing device for display to a user and further to allow the user to play a musical instrument in conjunction with the multimedia presentation. In response to a user selecting a musical piece at the computing device, a server transmits a session file associated with the musical piece to the computing device through a computer network. The session file includes an audio file and multimedia data such that the computing device can process the session file to present the multimedia presentation of the audio file to the user. An interface device is connected to the computing device and to the user&#39;s musical instrument. The interface device couples the musical instrument to the computing device such that the user can play the musical instrument in conjunction with the multimedia presentation of the audio file.

BACKGROUND

1. Field of the Invention

This invention relates to delivering a multimedia presentation to auser. In particular, the invention relates to delivering a multimediapresentation of an audio file to a user such that the user can play amusical instrument in conjunction with the multimedia presentation.

2. Description of Related Art

Many software packages that utilize digital signal processing (DSP)algorithms have been developed to allow computer users to use theircomputer to create and edit music. Further, the development of the MIDI(Musical Instrument Digital Interface) standard protocol has allowed forthe interchange of musical information between musical instruments,synthesizers and computers. The MIDI protocol defines the codes for amusical event, which includes the start of a note, its pitch, lead,volume and musical attributes such as vibrato. A computer with a MIDIinterface can be used to record a musical session, but instead ofrecording the analog sound wave as in a tape recorder, the computerstores the music as keystroke and control codes. The recording can thenbe edited utilizing a software package in an entirely different mannerthan the conventional recording; for example, the rhythm can be changedby editing the time codes in the MIDI messages. As another example, thecomputer can easily transpose a performance from one key to another. Themultitude of ways that a MIDI recording can be edited is virtuallylimitless.

Moreover, specific software programs have been developed, with andwithout the use of MIDI, to allow users to use their computer to makemusic by inputting a musical instrument (e.g. a keyboard or guitar) intotheir computer. Generally, the analog audio signal from the musicalinstrument undergoes analog to digital (A/D) conversion (e.g. performedby a sound card in the computer) and the digital version of the audiosignal can then undergo digital signal processing by the computer suchthat it can be altered by a computer program. This alteration can occurunder the control of the user (e.g. for music editing) or in pre-definedways by the software program. The digitally altered signal can then beconverted back to analog form (e.g. digital to analog (D/A) conversion)for playback to the user. For example, a user playing a guitar hookedinto his or her computer could choose that the guitar audio signal bedigitally altered such that it is played back in a distorted manner.

Unfortunately, with all the advances in digital signal processing toallow user's to use their computers to make and edit music, computershave still not been fully utilized in a manner that facilitates userslearning how to play music effectively. Moreover, users do not currentlyhave quick and easy access to a wide array of musical choices from whichto learn.

SUMMARY OF THE INVENTION

The present invention relates to a system and method to deliver amultimedia presentation of an audio file to a computing device fordisplay to a user and further allows the user to play a musicalinstrument in conjunction with the multimedia presentation.

In one embodiment, in response to a user selecting a musical piece at acomputing device, a server transmits a session file associated with themusical piece to the computing device through a computer network. Thesession file includes an audio file and multimedia data such that thecomputing device can process the session file to present a multimediapresentation of the audio file to the user. An interface device isconnected to the computing device and the user's musical instrument. Theinterface device couples the musical instrument to the computing devicesuch that the user can play the musical instrument in conjunction withthe multimedia presentation of the audio file. Thus, users are providedquick and easy access to a wide variety of musical pieces that they candownload from a server, and the user can then play along with thedownloaded musical piece, which is presented in a multimediapresentation format to facilitate learning.

BRIEF DESCRIPTION OF THE DRAWINGS

The features and advantages of the present invention will becomeapparent from the following description of the present invention inwhich:

FIG. 1 is a block diagram illustrating an exemplary system to deliver amultimedia presentation of an audio file to a computing device,according to one embodiment of the present invention.

FIG. 2 a illustrates a conventional data processing or computer systemuseable with embodiments of the present invention.

FIG. 2 b illustrates a typical architecture of the conventional dataprocessing or computer system shown in FIG. 2 a.

FIG. 3 a illustrates a top view of an interface device, according to oneembodiment of the present invention.

FIG. 3 b illustrates a front view of the interface device, according toone embodiment of the present invention.

FIG. 3 c illustrates a back view of the interface device, according toone embodiment of the present invention.

FIG. 3 d is a schematic view of the internal components of the interfacedevice, according to one embodiment of the present invention.

FIG. 4 is a block diagram illustrating a more detailed view of theexemplary system to deliver a multimedia presentation of an audio fileto a computing device of FIG. 1, showing typical software modulesutilized, according to one embodiment of the present invention.

FIG. 5 a is a flowchart illustrating a method for delivering amultimedia presentation to user, according to one embodiment of thepresent invention.

FIG. 5 b is a flowchart illustrating a method of providing a tone to auser, according to one embodiment of the present invention.

FIG. 5 c is a flowchart illustrating a method of providing a musicalpiece to a user, according to one embodiment of the present invention.

FIG. 5 d is a diagram illustrating the contents of a session file,according to one embodiment of the present invention.

FIG. 6 a is a screenshot particularly illustrating the control panelgraphical interface for a guitar (e.g. for the embodiment where themusical instrument is a guitar), according to one embodiment of thepresent invention.

FIG. 6 b is a screenshot of the display illustrated to the user whenthey successfully log on to the server, according to one embodiment ofthe present invention.

FIG. 6 c is a screenshot showing the display illustrated to the userwhen the user has selected a musical piece (e.g. a Jamtrack), andparticularly shows a multimedia presentation (e.g. with music notation)for the selected musical piece such that the user can play his or herguitar in conjunction with the multimedia presentation, according to oneembodiment of the present invention.

FIG. 7 a illustrates a security system, according to one embodiment ofthe present invention.

FIG. 7 b illustrates the pertinent security components of the securitydevice used in the security system, according to one embodiment of thepresent invention.

FIG. 8 a is a flow diagram illustrating a process for the server toauthenticate the security device, according to one embodiment of thepresent invention.

FIG. 8 b is a flow diagram illustrating a process for the securitydevice to respond to an authentication challenge from the server,according to one embodiment of the present invention.

FIG. 8 c is a flow diagram illustrating a process for the server toupdate the security device with the current date and the subscriptionexpiration date, according to one embodiment of the present invention.

FIG. 8 d is a flow diagram illustrating a process for the server tounlock the security device memory of the security device, according toone embodiment of the present invention.

FIG. 8 e is a flow diagram illustrating a process for the securitydevice to update the current and subscription expiration dates receivedfrom the server, according to one embodiment of the present invention.

FIG. 8 f is a flow diagram illustrating a process for the server to lockthe nonvolatile memory of the security device memory of the securitydevice, according to one embodiment of the present invention.

FIG. 8 g is a flow diagram illustrating a process for the securitydevice to lock the security device memory, according to one embodimentof the present invention.

FIG. 8 h is a flow diagram illustrating a process for the computingdevice to update the current date at the security device, according toone embodiment of the present invention.

FIG. 8 i is a flow diagram illustrating a process for the securitydevice to update the current date and time received from the computingdevice, according to one embodiment of the present invention.

FIG. 9 illustrates an example of a secure asset delivery system,according to one embodiment of the present invention.

FIG. 10 a is a flow diagram illustrating a process for the server toencrypt assets, according to one embodiment of the present invention.

FIG. 10 b is a flow diagram illustrating a process for the server todeliver assets, according to one embodiment of the present invention.

FIG. 10 c is a flow diagram illustrating a process by which thecomputing device perform the functions of extracting an asset key fromthe security device, according to one embodiment of the presentinvention.

FIG. 10 d is a flow diagram illustrating a process by which thecomputing device performs the functions of decrypting an asset,according to one embodiment of the present invention.

FIG. 10 e is a flow diagram illustrating a process by which the securitydevice extracts the asset key, according to one embodiment of thepresent invention.

DETAILED DESCRIPTION

In the following description, the various embodiments of the presentinvention will be described in detail. However, such details areincluded to facilitate understanding of the invention and to describeexemplary embodiments for implementing the invention. Such detailsshould not be used to limit the invention to the particular embodimentsdescribed because other variations and embodiments are possible whilestaying within the scope of the invention. Furthermore, althoughnumerous details are set forth in order to provide a thoroughunderstanding of the present invention, it will be apparent to oneskilled in the art that these specific details are not required in orderto practice the present invention. In other instances details such as,well-known methods, types of data, protocols, procedures, components,networking equipment, processes, interfaces, electrical structures,circuits, etc. are not described in detail, or are shown in blockdiagram form, in order not to obscure the present invention.Furthermore, aspects of the invention will be described in particularembodiments but may be implemented in hardware, software, firmware,middleware, or a combination thereof.

Referring now to FIG. 1, FIG. 1 shows a block diagram illustrating anexemplary system 100 to deliver a multimedia presentation of an audiofile to a computing device 102, according to one embodiment of thepresent invention. One or more servers 104 are coupled to computingdevice 102 through a computer network (e.g. the Internet) 105. In oneembodiment, in response to a user selecting a musical piece at acomputing device 102, server 104 transmits a session file associatedwith the musical piece to the computing device 102 through the computernetwork (e.g. the Internet) 105. The session file includes a digitalaudio file and multimedia data. The computing device 102 processes thesession file to present the multimedia presentation of the audio file tothe user, as will be discussed. The server or server(s) 104 are alsocoupled through network connections to an asset database 107 that storessession files, and other assets, and a user information database 109that stores information related to users, as will be discussed.

An interface device 106, including a security device 110, is connectedto the computing device 102 and the user's musical instrument 112 (e.g.a guitar). The interface device 106 couples the musical instrument 112to the computing device 102 over an input/output (I/O) link 114 (e.g. aUniversal Serial Bus link) such that the user can play the musicalinstrument 112 in conjunction with a multimedia presentation of thedigital audio file being processed by the computing device 102.Furthermore, the interface device 106 can be connected an analog sounddevice, such as amplified speakers 120 or headphones 122, to play theaudio file associated with selected musical piece along with sound fromthe user's musical instrument 112, as the user plays along with his orher musical instrument.

More specifically, the interface device 106 performs analog to digital(A/D) conversion of the audio signal from the musical instrument 112 andtransmits the digitized audio signal of the musical instrument 112 viaI/O link 114 to the computing device 102 where the digitized audiosignal of the musical instrument 112 may undergo digital signalprocessing (DSP) performed by a software module to create a processeddigital audio signal of the musical instrument, for example, to tailorit to the audio file of the musical piece that was selected by the user.The computing device 102 creates a mixed digital signal of both thedigital audio file and the processed digital signal of the musicalinstrument, which is transmitted back from the computing device 102 link114 to the interface device 106, where the mixed digital signal isconverted to analog form (D/A conversion) into a mixed analog audiosignal that is outputted through an analog sound device, such asspeakers 120 or headphones 122. Thus, a user can play along with thedownloaded musical piece, which is presented in a multimediapresentation format on the computing device, to facilitate learning bythe user. Moreover, as will be discussed, the user is provided withquick and easy access to a wide variety of musical pieces that they candownload from the server 104.

It should be appreciated by those having skill in the network-relatedarts that computing device 102 and the server(s) 104 may be coupled tothe computer network 105 in a variety of ways including through director dial-up telephone or other network transmission lines, using a modempool (not illustrated), or through an additional network and gateway(not illustrated). For example, the computing device 102 can communicatewith a server 104 via a link utilizing one or more of the plain oldtelephone system (POTS), a cellular phone system, cable, DigitalSubscriber Line, Integrated Services Digital Network, satelliteconnection, computer network (e.g. the Internet, a wide area network(WAN), or a local area network (LAN), etc.), or generally any sort ofprivate or public telecommunication system, and combinations thereof.Examples of a transport medium for the links include, but are notlimited or restricted to electrical wire, optical fiber, cable includingtwisted pair, or wireless channels (e.g. radio frequency (RF),terrestrial, satellite, or any other wireless signaling methodology).

More particularly, the computer network 105 is typically a computernetwork (e.g. the Internet, a wide area network (WAN), or a local areanetwork (LAN), etc.), which is a packetized, packet-switched, connectionoriented, etc., network that can utilize Transmission ControlProtocol/Internet Protocol (TCP/IP), Asynchronous Transfer Mode (ATM),Frame Relay (FR), Point-to Point Protocol (PPP), Systems NetworkArchitecture (SNA), Voice over Internet Protocol (VoIP), or any othersort of protocol. The computer network 105 allows the communication ofdata traffic between the computing device 102 and the server(s) 104using packets. Data traffic through the network computer 105 may be ofany type including audio, text, graphics, video, e-mail, Fax,multimedia, documents, voice, and other generic forms of data. Thecomputer network 105 is typically a data network that may containswitching or routing equipment designed to transfer digital datatraffic. It should be appreciated that the FIG. 1 environment is onlyexemplary and that embodiments of the present invention can be used withany type of telecommunication system and/or computer network, protocols,and combinations thereof. Moreover, the network connections between theserver(s) 104 and the asset database 107 and user information database109 can also be coupled in ways exemplified by the previously describedexamples.

Having briefly described an exemplary network environment in whichembodiments of the present invention can be practiced, FIG. 2 aillustrates a conventional data processing or computer system 200useable with embodiments of the present invention. More particularly,FIG. 2 a illustrates an example of a general data processing orcomputing system 200 for use as an exemplary computing device 102 (e.g.personal computer) or server computer system 104, in which variousaspects of the present invention may be utilized.

As illustrated, data processing or computer system 200 is comprised of asystem unit 202, output devices such as display device 204 and printer210, and input devices such as keyboard 208, and mouse 206. Dataprocessing system 200 receives data for processing by the manipulationof input devices 208 and 206 or directly from fixed or removable mediastorage devices such as disk 212 and network connection interfaces (notillustrated). Data processing system 200 then processes data andpresents resulting output data via output devices such as display device204, printer 210, fixed or removable media storage devices like disk 212or network connection interfaces. It should be appreciated that thecomputing device 102 can be any sort of computer system or computingdevice (e.g. personal computer (laptop/desktop), network computer,handheld computing device, server computer, or any other type ofcomputer). Moreover, in the case of the computing device 102, the dataprocessing system 200 includes a serial I/O port 113 (e.g. a USB port)to accommodate input and output data from the interface device 102through I/O link 114 (e.g. a USB link).

Referring now to FIG. 2 b, there is depicted a high-level block diagramof the components of a data processing system 200 such as thatillustrated by FIG. 2 a. In a conventional computer system, system unit202 includes a processing device such as processor 220 in communicationwith main memory 222 which may include various types of cache, randomaccess memory (RAM), or other high-speed dynamic storage devices via alocal or system bus 214 or other communication means for communicatingdata between such devices. The processor processes information in orderto implement the functions of the embodiments of the present invention.As illustrative examples, the “processor” may include a centralprocessing unit having any type of architecture such as complexinstruction set computers (CISC), reduced instruction set computers(RISC), very long instruction word (VLIW), or hybrid architecture, or adigital signal processor, a microcontroller, a state machine, etc.

Main memory 222 is capable of storing data as well as instructions to beexecuted by processor 220 and may be used to store temporary variablesor other intermediate information during execution of instructions byprocessor 220. Computer system 200 also comprises a read only memory(ROM) and/or other static storage devices 224 coupled to local bus 214for storing static information and instructions for processor 220.Examples of non-volatile memory 224 include a hard disk, flash memory,battery-backed random access memory, Read-only-Memory (ROM) and the likewhereas volatile main memory 222 includes random access memory (RAM),dynamic random access memory (DRAM) or static random access memory(SRAM), and the like.

System unit 202 of data processing system 200 also features an expansionbus 216 providing communication between various devices and devicesattached to the system bus 214 via bus bridge 218. A data storage device228, such as a magnetic disk 212 or optical disk such as a CD-ROM or DVDand its corresponding drive may be coupled to data processing system 200for storing data and instructions via expansion bus 216. Computer system200 can also be coupled via expansion bus 216 to a display device 204,such as a cathode ray tube (CRT) or a liquid crystal display (LCD), fordisplaying data to a computer user such as generated meeting packagedescriptions and associated images. Typically, an alphanumeric inputdevice 208, including alphanumeric and other keys, is coupled to bus 216for communicating information and/or command selections to processor220. Another type of user input device is cursor control device 206,such as a conventional mouse, trackball, or cursor direction keys forcommunicating direction information and command selection to processor220 and for controlling cursor movement on display 204. Moreover, in thecase of the computing device 102, the data processing system 200includes a serial I/O port 113 (e.g. a USB port) to accommodate inputand output data from the interface device 106 through serial I/O link114 (e.g. a USB link).

A communication device 226 is also coupled to bus 216 for accessingremote computers or servers, such as server 104, or other servers viathe Internet, for example. The communication device 226 may include amodem, a network interface card, or other well-known interface devices,such as those used for interfacing with Ethernet, Token-ring, or othertypes of networks. In any event, in this manner, the computer system 200may be coupled to a number of servers 104 via a network infrastructuresuch as that illustrated in FIG. 1 and described above.

In continuing with the example of the conventional data processing orcomputer system 200, both the computing device 102 and server 104 mayoperate under the control of an operating system that is booted into thememory of the device for execution when the device is powered-on orreset. In turn, the operating system controls the execution of one ormore software modules or computer programs. These software modulestypically include application programs that aid the user in utilizingthe computing device 102 and the server 104, and the various functionsassociated with delivering a multimedia presentation of an audio file toa computing device 102 for display to user, and to allow the user toplay a musical instrument in conjunction with the multimediapresentation, as well as, other functions related to security andcommerce methods, as will be discussed.

These functions can be implemented as one or more instructions (e.g.code segments), to perform the desired functions of the invention. Whenimplemented in software (e.g. by a software module), the elements of thepresent invention are the instructions/code segments to perform thenecessary tasks. The instructions which when read and executed by amachine or processor (e.g. processor 220), cause the machine orprocessor to perform the operations necessary to implement and/or useembodiments of the invention. The instructions or code segments can bestored in a machine readable medium (e.g. a processor readable medium ora computer program product), or transmitted by a computer data signalembodied in a carrier wave, or a signal modulated by a carrier, over atransmission medium or communication link. The machine-readable mediummay include any medium that can store or transfer information in a formreadable and executable by a machine (e.g. a processor, a computer,etc.). Examples of the machine readable medium include an electroniccircuit, a semiconductor memory device, a ROM, a flash memory, anerasable programmable), a floppy diskette, a compact disk CD-ROM, anoptical disk, a hard disk, a fiber optic medium, a radio frequency (RF)link, etc. The computer data signal may include any signal that canpropagate over a transmission medium such as electronic networkchannels, optical fibers, air, electromagnetic, RF links, etc. The codesegments may be downloaded via networks such as the Internet, Intranet,etc.

Turning now to FIG. 3 a, FIG. 3 a illustrates a top view of an interfacedevice 106, according to one embodiment of the present invention. Theinterface device 106 couples the musical instrument 112 to the computingdevice 102 over the input/output (I/O) link 114 such that the user canplay a musical instrument 112 in conjunction with a multimediapresentation of the audio file being processed by the computing device102. As shown in the top view of FIG. 3 a, the interface device 106includes a volume dial or knob 304 to adjust the volume of the musicalinstrument 112 and the audio file and an LED indicator 308 to indicateinterface device operating status (i.e. whether power is on or off). Theinterface device 106 can include a metal, plastic, or metallized plastichousing to contain the internal electronic components. Turning brieflyto FIG. 3 b, which illustrates a front view of the interface device 106,according to one embodiment of the invention, the interface deviceincludes an input port 310 to receive an input jack (or other inputdevice) from a musical instrument 112 such that the musical instrumentis electrically coupled to the interface device 106.

Referring now to FIG. 3 c, FIG. 3 c illustrates a back view of theinterface device 106, according to one embodiment of the presentinvention. The interface device 106 includes left and right speakeroutput ports 320 and 322 that can be used to accept speaker jacks foramplified speakers 120 so that the interface device 106 can be connectedto amplified speakers. This allows a user playing his or her musicalinstrument 112 to hear both the musical instrument as well as an audiofile associated with the musical piece being processed by the computingdevice 102. Furthermore, the interface device 106 includes an additionalline in port 323. For example, the additional line in port 323 can beused to support input from a sound card of the computing device 102 suchthat sounds from games and other software programs from the computingdevice 102 can simply be routed through the interface device 106 to thespeakers 120 or headphones 122.

Also, interface device 106 includes a headphone output port 326 that canbe used to accept a headphone jack for headphones 122 to allow the userto listen to his or her musical instrument 112, as well as the audiofile, using headphones 122. The interface device 106 further includes aserial I/O port 330 (e.g. a USB port) to accept an I/O connector (e.g. aUSB connector) such that the I/O link 114 (e.g. a USB link) can beformed between the interface device 106 and the computing device 102. Itshould be appreciated that the interface device 106 can also include anynumber of other input and outputs.

Turning now to FIG. 3 d, FIG. 3 d is a schematic view of the internalcomponents 334 of the interface device 106, according to one embodimentof the present invention. The interface device 106 includes amicroprocessor 340 that controls components of the interface device 106to perform functions related to A/D and D/A conversion of signalsbetween the musical instrument 112 and the computing device 102, as wellas security functions utilizing a security device 110, as will bediscussed in more detail later.

As shown in FIG. 3 d, the interface device 106 includes an instrument inline from input port 310 that is connected to an amplifier 336. Thus, asan example, an analog audio signal from a musical instrument 112 comingin from input port 310 is amplified by amplifier 336. The amplifier 336is connected to an analog to digital (A/D) converter 338 such that theamplified analog audio signal is processed by the A/D converter 338 andis converted into a digitized audio signal of the musical instrument.

The microprocessor 340 of the interface device 106 is coupled tocomponents of the security device 110, a buffer RAM 344, and a digitalaudio interface 346. The microprocessor 340 controls components 334 ofthe interface device 106 to perform functions related to A/D and D/Aconversion of signals between the musical instrument 112 and thecomputing device 102. The digital audio interface 346 performsconventional functions related to formatting and timing the digitizedaudio signals. The digital audio interface 346 may include a number oftiming clocks to perform these functions. Thus, continuing with thepresent example, the digitized audio signal of the musical instrument112 is next formatted by the digital audio interface 346. Further, thedigital audio interface 346 is coupled to a buffer RAM 344 that is usedto store portions of the digitized audio signal for rate matching.

Moreover, the buffer RAM 344 is connected to the microprocessor 340 anda serial I/O controller 348. The serial I/O controller 348 controls theflow of digital data to and from the computing device 102 along serialI/O link 114. In one example, the serial I/O controller 348 can be a USBcontroller and the serial I/O link 114 can be a USB link. The digitaldata controlled by the serial I/O controller 348 can include thedigitized audio signal coming directly from the musical instrument 112which is being sent to the computing device 102 for digital signalprocessing the mixed digital signal of both the processed digital audiosignal of the musical instrument that has under the computing device 102and the digital audio file associated with selected musical piece comingfrom the computing device 102. However, it should be appreciated thatthe digitized signal of the musical instrument does not have to bepassed through the computing device 102 for DSP processing and can bepassed straight through to the DAC 350 and onto the analog sound devicesuch that the user can still play along with an audio file. The bufferRAM 344 is also used to store the digital audio signal of the musicalinstrument (pre-DSP processing), the digital audio file, and the mixeddigital signal, for conventional purposes, such as rate matching.

The digital audio interface 346 is further connected to a digital toanalog converter (DAC) 350. The mixed digital signal of both theprocessed digital audio signal of the musical instrument and the digitalaudio file from the computing device 102 are processed by the DAC 350 toconvert this mixed digital signal into analog form, i.e. a mixed analogaudio signal, such that the mixed analog audio signal can be played backthrough an analog sound device, such as amplified speakers 120 orheadphones 122. However, as previously discussed, it should beappreciated that the digitized signal of the musical instrument does nothave to be passed through the computing device 102 for DSP processingand can be passed straight through to the DAC 350 and onto the analogsound device such that the user can still play along with an audio file.

Connected to the outputs of the DAC 350 is a mixer 352. The mixer 352receives analog audio signal inputs from other line in sources such asthe line in port 323, which are amplified by amplifiers 358 and 360,respectively, such that they can also be played through the amplifiedspeakers 120 or headphones 122.

These additional analog audio signal inputs from line in port 323 can bemixed with the analog audio signal of the musical instrument and theaudio file or can simply be routed through the interface device to thespeakers 120 or headphones 122. For example, the additional line ininputs from line in port 323 can be from a sound card of the computingdevice 102 such that sounds from games and other software programs fromthe computing device 102 can simply be routed through the interfacedevice 106 to the speakers 120 or headphones 122. In this way, othersoftware programs can still be used with the interface device 106 hookedup to the computing device 102 (e.g. a personal computer), and the userdoes not have to reconfigure his or her personal computer system toswitch between using the interface device and not using the interfacedevice.

The analog signals from the mixer 352 are then passed through line outs(e.g. left and right) 360 and 362 via speaker ports and 320 and 322 tothe amplified speakers 120. Particularly, the analog signals can beamplified by amplifiers 364 and 366 under the control of a volumecontroller 368, which is in turn controlled by the volume dial 304.Similarly, the analog signals from the mixer 352 are also passed throughthe line outs 360 and 362 (e.g. left and right) via headphone port 326to the headphones 122. Likewise, the analog signals can be amplified byamplifiers 374 and 376 under the control of the volume controller 368,which is in turn controlled by the volume dial 304.

Thus, the interface device 106 couples a musical instrument 112 to acomputing device 102 over an input/output (I/O) link 114 such that theuser can play a musical instrument 112 in conjunction with a multimediapresentation of an audio file being processed by the computing device102. More specifically, as previously described, the interface device106 performs analog to digital (A/D) conversion of the audio signal fromthe musical instrument 112 and transmits the digitized audio signal ofthe musical instrument via I/O link 114 to the computing device 102where the digitized audio signal of the musical instrument 112 mayundergo digital signal processing (DSP) performed by a software module(e.g. to tailor it to the audio file of the musical piece that wasselected by the user). A mixed digital signal of both the digital audiofile and the processed digital signal of the musical instrument istransmitted back from the computing device 102 along I/O link 114 to theinterface device 106 where the mixed digital signal is converted toanalog form (D/A conversion), i.e. a mixed analog audio signal, which isoutputted through the speakers 120 or headphones 122. Thus, a user canplay along with the downloaded musical piece, which is presented in amultimedia presentation format on the computing device, as will bediscussed later, to facilitate learning by the user.

Interface device 106 also includes a security device 110. The securitydevice 110 includes components that can be utilized to uniquely identifythe interface device 106 to the server 104 such that access to theserver 104 is only granted to a user operating with an authorizedinterface device. Moreover, the security device 110 in conjunction withthe server 104, is used to ensure that audio files are properlyencrypted and decrypted such that only a properly authorized interfacedevice 106 can receive and utilize audio files. This protects againstunauthorized duplication of licensed material and provides a securerevenue opportunity for content (e.g. audio file) providers.

The security device includes a microprocessor 340, a secure memory 379having security logic 380, program storage 382 to store securityfirmware 383, and nonvolatile memory (e.g. EEPROM) 384. Generally, thesecurity firmware 383 when executed by the microprocessor 340 inconjunction with the secure memory 379 and the nonvolatile memory 384,provide for secure operations that allow the server 104 to uniquelyidentify the interface device 106 and allow the computing device 102 inconjunction with the interface device 106 to decrypt audio filesspecifically encrypted for use by the authorized interface device 106.The secure memory 379 includes both read-only memory (ROM) and writeablememory, which can be locked and unlocked for reading and writing usingthe hardware implemented security logic 380.

A user key 387 associated with serial number 386 of the interface device106 is used by the security logic 380 to authenticate the interfacedevice 106 to the server 104. Also, a memory key 389 is used by thesecurity logic 380 to initially unlock the secure memory 379. The serialnumber 386, user key 387, and memory key 389 are sealed in the securememory 379 during manufacturing and thereafter can no longer be writtenover once the secure memory 379 is sealed. The serial number 386, userkey 387, and memory key 389 are also stored at the server's userinformation database 109 so that the server 104 can initially generate achallenge and response to uniquely authenticate the interface device 106and open and lock the secure memory 379 and the nonvolatile memory 384,as will be discussed in more detail later.

The nonvolatile memory 384 is used as an extension to the secure memory379. The firmware 383 prevents access to the nonvolatile memory 384unless the secure memory 379 has also been unlocked. The nonvolatilememory 384 has hardware write protection, which is controlled by thefirmware 383. The nonvolatile memory 384 stores keys 388 such as assetencryption keys (e.g. audio file keys) associated with particularpurchased assets (e.g. audio files), the current date and subscriptiondates for certain assets 390, and asset information (e.g. informationabout assets) 392. It should be appreciated that the serial number 386,the user key 387, the memory key 389, keys 388, the dates 390, the assetinformation 392 and even the firmware 383 can instead be located orco-located at any of the security device memories: program storage 382,secure memory 379, or nonvolatile memory 384; this particulararrangement being only one embodiment.

As will be discussed in more detail later, the security device 110 inconjunction with the computing device 102 and the server 104, allow theserver 104 to uniquely identify the interface device 106 and allow thecomputing device 102 in conjunction with the interface device 106 todecrypt audio files specifically encrypted for use by the authorizedinterface device 106, along with many other functions.

FIG. 4 is a block diagram illustrating a more detailed view of theexemplary system 100 to deliver a multimedia presentation of an audiofile to a computing device 102, showing typical software modulesutilized, according to one embodiment of the present invention. Briefly,as previously discussed, server(s) 104 are coupled to computing device102 through a computer network (e.g. the Internet) 105. Further, aninterface device 106 is coupled to the computing device 102 and amusical instrument 112 is coupled to the interface device. In oneembodiment, in response to a user selecting the musical piece at acomputing device 102, server 104 transmits a session file associatedwith a musical piece to the computing device 102 through the computernetwork (e.g. the Internet) 105. The session file includes an audio fileand multimedia data. The computing device 102 processes the session fileto present the multimedia presentation of the audio file to the usersuch that a user can play a musical instrument 112 in conjunction with amultimedia presentation of the audio file being processed by thecomputing device 102.

More particularly, as shown in FIG. 4, the computing device 102 andserver 104 each include a plurality of software modules that enable thefunctions of the embodiments of the present invention. These softwaremodules typically include application programs that aid the user inutilizing the computing device 102 and the server 104, and the variousfunctions associated with delivering a multimedia presentation of anaudio file to a computing device 102 for display to user, and to allowthe user to play a musical instrument in conjunction with the multimediapresentation, as well as, other functions related to security andcommerce methods, as will be discussed. For example, the computingdevice 102 includes an application software module 402 that furtherincludes an embedded browser 404, an audio playback software module 406,and a security software module 408. Further the computing device 102includes a device driver software module 410 and an audio DSP sofwaremodule 412. On the server side, the server 104 includes a serversoftware module 415, an application software module 416, a databasesoftware module 418, a commerce software module 420, and a securitysoftware module 422.

The application software module 402 of the computing device 102interfaces and controls the implementation of the embedded browser 404and all the other software modules (e.g. the audio DSP software module412, the audio playback software module 406, the device driver softwaremodule 410 and the security software module 408) such that theembodiments of the invention related to displaying a multimediapresentation of an audio file to a user to allow the user to play amusical instrument in conjunction with a multimedia presentation, aswell as other functions related to security and commerce functions, areproperly implemented. In one embodiment, the application software module402 in conjunction with the embedded browser 404 initially displays aWeb page (e.g. a home page) to the user providing the user with amultitude of musical pieces from which to select. The embedded browser404 is specifically tailored for the application software module 402 andits various functions and can be based on any type of conventionallyknown browsers such as Microsoft Explorer.

The application software module 402 also causes the display of a controlpanel graphical interface for a musical instrument 112 that includessettings that define sound characteristics for the musical instrument.The control panel graphical interface also allows the user to set soundcharacteristics for the musical instrument 112. Further, in response tothe multimedia data of the session file for a selected musical piece(e.g. selected by the user) sent to the computing device 102 by theserver 104, the application software module 402 sets the settings of thecontrol panel graphical interface to predefined values to model thesound characteristics of the musical instrument associated with theaudio file for the musical piece selected by the user. Also, theapplication software module 402 can play a musical piece selected by theuser (e.g. and sent from the server 104 to the computing device 102),that has a track associated with the user's musical instrument removedfrom the audio file, such that the user can play his or her musicalinstrument 112 in conjunction with a multimedia presentation of theaudio file that does not include the user's musical instrument.Moreover, the application software module 402 processes the multimediadata of the session file to cause the display of music notationassociated with the audio file of the musical piece to the user. Thedisplay of the multimedia presentation may occur on a display device 204of the computing device 102 and sound can be routed through theamplified speakers 120 of the interface device 106.

In order to accomplish these functions, the application software module402 utilizes a conventional device driver software module 410, an audioDSP software module 412, and an audio playback software module 406. Theaudio DSP software module 412 processes the audio signal of the musicalinstrument 112 (e.g. utilizing DSP algorithms) such that the user canset the sound characteristics for the musical instrument. As previouslydescribed, the audio DSP software module 412 can be utilized by theapplication software module 402 to set the settings of the control panelgraphical interface to predefined values to model the soundcharacteristics of the musical instrument such that it is properlyassociated with a musical piece selected by the user. Furthermore, theaudio DSP software module 412 combines both the digital audio file andthe processed digital audio signal of the musical instrument to createthe mixed digital audio signal, previously discussed. Moreover, theapplication software module 402 controls an audio playback softwaremodule 406 to control the transmission of the mixed digital signal ofthe digital audio file and the digitally processed sound of the musicalinstrument 112 back to the interface device 106 where it is played backthrough amplified speakers 120 or headphones 122 to the user. However,the application software module 402 can also control the audio playbacksoftware module 406 to control the transmission of only the digitalaudio file, in the case where the musical instrument is only routedthrough the interface device 106 and not the computing device 102 forprocessing. It should be appreciated audio DSP software modules for avariety of different musical instruments are known in the art. Forexample, general type of DSP software modules that can alter MIDI filesare well known (e.g. MIDI SHOP). Also, audio playback software modulesthat are used to playback audio files and audio signals from musicalinstruments are also well known.

In one particular embodiment, that will hereinafter be used to describeaspects of the present invention, the application software module 402,the audio DSP software module 412, the Web page the user logs on to, andthe control panel graphical interface are directed to support a guitaras the musical instrument 112. In particular, it should be appreciatedthat DSP algorithms for altering the audio signals from a guitar areknown in the art and can be easily implemented in software on thecomputing device 102. For example, one example of DSP algorithms foraltering the audio signals from a guitar to model various amplifiers andspeaker cabinet configurations which may be used in the audio DSPsoftware module 412 to implement aspects of the present invention areparticularly described in U.S. Pat. No. 5,789,689 entitled “TubeModeling Programmable Digital Guitar Amplification System”, which ishereby incorporated by reference. Moreover, a wide variety of softwareimplemented control panel graphical interfaces for a multitude ofdifferent instruments are known, and there are some basic control panelgraphical interfaces known for guitars, e.g. AMP FARM includes one typeof software implemented control panel graphical interface for a guitar.However, none of them include many of the novel and non-obvious featuresof the guitar control panel graphical interface to be described in moredetail later. Furthermore, the aspects of the security software module408 of the computing device 102 will also be described in more detaillater.

In one embodiment of the present invention, the server 104 includes aserver software module 415, an application software module 416, adatabase software module 418, a commerce software module 420, and asecurity software module 422. The application software module 416interfaces and controls the implementation of the server software module415 and all the other software modules (e.g. the database softwaremodule 418, the commerce software module 420, and the security softwaremodule 422), at the server 104 such that the embodiments of theinvention related to displaying a multimedia presentation of an audiofile to a user to allow the user to play a musical instrument inconjunction with the multimedia presentation, as well as other functionsrelated to security and commerce functions, are properly implemented.

At the server 104, the application software module 416 in conjunctionwith the server software module 415 provides the computing device 102with the data necessary to implement the functions of the invention, aswill be discussed. The server software module 415 can be conventionalserver software for transmitting and receiving data to and fromcomputing devices 102. For example, using the Hypertext TransferProtocol (HTTP) and Hypertext Markup Language (HTML) or ExtensibleMarkup Language (XML), the server 104 can communicate with the computingdevice 102 across the computer network 105 to provide various functionsand data to the user. At the computing device 102, utilizing theembedded browser 404, which is part of the application software module402, or even other browsers such as Netscape™ Navigator™ published byNetscape™ Corporation of Mountain View, Calif., the Internet Explorer™published by Microsoft™ Corporation of Redmond, Wash., the userinterface of America Online™, or any other browser or HTML/XMLtranslator from a well-known supplier, computing device 102 may supplydata to, and access processed or unprocessed data from, the server 104.

According to one embodiment of the present invention, as previouslydiscussed, the server software module 415 under the control of theapplication software module 416 transmits a session file to thecomputing device 102 through the computer network 105, in response touser selecting a musical piece at the computing device 102. The sessionfile includes an audio file and multimedia data such that the computingdevice 102 can process the session file to present a multimediapresentation to the user to allow the user to play his or her musicalinstrument 112 (e.g. a guitar) in conjunction with the multimediapresentation of the audio file. Moreover, as will be discussed, theserver software module 415, under the control of the applicationsoftware module 416, receives and transmits a variety of different typesof data to and from the computing device 102 to implement the functionsof the invention.

The database software module 418 can be conventional database software,such as MySQL, to control the input and output of data from the assetdatabase 107 and the user information database 109, under the control ofthe application software module 416, as will be discussed in more detaillater. Furthermore, the aspects and functions of the commerce softwaremodule 420 and security software module 422 will be discussed in moredetail later.

The data communicated between the server 104 and the computing device102 includes session files having multimedia data and audio files, userinformation, commerce information to track the purchases and licensingrestriction of audio files and other items, security informationincluding encrypted keys and encrypted asset and audio files, multimediadata for the presentation of a Web-site, along with a multitude of otherdata. Much of the information related to session files, multimedia data,audio files, commerce information, and other assets, as will bediscussed, may be stored in the asset database 107. User informationincluding the user's name, email address, home address, computerconnection speed, credit card number, subscription information, type ofcomputer, the type of musical preferences the user has, and securityinformation including a user's serial number for his or security device110, user key, memory key, and other user information, as will bediscussed, may be stored in the user information database 109. It willbe readily appreciated by those having ordinary skill in the relevantarts that the asset database 107 and user information database 109 maybe stored in storage devices including various mass storage devices suchas one or more DASD arrays, tape drives, optical drives, or the like,and that the aforementioned information may be stored in any one of avariety of formats or data structures.

In one particular embodiment, that will hereinafter be used to describesome of the aspects of the present invention, the computing device 102,the server 104 and its associated asset and user information databases107 and 109, and the interface device 106, along with the associatesoftware modules, are used to support a guitar 112 as the musicalinstrument. However, it should be appreciated by those skilled in theart that the present invention may be used to support any type ofmusical instrument. Moreover, it should be appreciated that the presentinvention can also support the case where a microphone is used as themusical instrument and the input audio signal is a human voice such thatembodiments of the invention could operate as a virtual karaoke machine.These aspects will be further appreciated after a further reading of thedisclosure.

With reference also to FIG. 5 a, FIG. 5 a is a flowchart illustrating amethod 500 for delivering a multimedia presentation to a user, accordingto one embodiment of the present invention, utilizing the previouslydescribed exemplary system 100 of FIG. 4. At block 502, after a user hasloaded the application software module 402 onto his or her computingdevice 102, the application software module 402 presents the user with acontrol panel graphical interface 600 as shown in FIG. 6 a. For example,the control panel graphical interface 600 can be displayed on thedisplay device 204 of the computing device 102. Next, the computingdevice 102 utilizing the application software module 402 permits theuser to log onto the server 104 and to access the server. According toone particular guitar embodiment, to be discussed hereinafter, theserver presents the user a Web-site related to guitars, hereinaftertermed the GUITARPORT Web-site. Thus, the user is first presented with aGUITARPORT homepage and other GUITARPORT Web pages thereafter.

With reference also to FIG. 6 a, logging on to the server 104 can beaccomplished by the user selecting the GUITARPORT online button 606. Forexample, the computing device 102 can contact the server 104 through thecomputer network (e.g. the Internet) utilizing standard computer networkprotocols (e.g. TCP/IP). At block 506, the server 104 under the controlof the application software module 416 and in conjunction with thesecurity software module 422 identifies the user based on a uniqueidentifier from the security device 110 (e.g. the Serial No. of theinterface device 106) to determine whether access to the server 104should be authorized. These security features will be discussed in moredetail later. If the user is not authorized by the server 104, then thesession is terminated at block 508. However, if the user is authorizedto utilize the server 104, then the method 500 moves on to block 510.

At block 510, the application software module 402 utilizing the embeddedbrowser 404 displays the server the GUITARPORT homepage received fromthe server 104, as shown in FIG. 6 b. The GUITARPORT homepage isinitially displayed beneath the guitar control panel graphical interface600. With reference also to FIG. 6 b, the GUITARPORT homepage includesFeatures, News, Discussion, Guitar Tools, Musical Pieces (e.g. NewestJamtracks), and Tones. The GUITARPORT homepage will be particularlydiscussed later. Moreover, based on user information for the user (e.g.particularly the musical preferences of the user) stored in the userinformation database 109 at the server 104, the server 104 canparticularly tailor the GUITARPORT homepage to fit the musicalpreferences of the user. For example, if a user prefers rock-and-rollthen the Newest Jamtracks (e.g. musical pieces) will be directed towardsrock-and-roll musical pieces, as well as, particular rock-and-rollTones. Further, the other components of the GUITARPORT homepage can alsobe geared to the user's preference, for example, News, Features, etc. Atblock 512, the user is allowed to select a Tone or a musical piece (e.g.a Jamtrack). If the user selects a tone then the method 500 proceeds toFIG. 5 b at block 514. On the other hand, if the user selects a musicalpiece (e.g. a Jamtrack) the method 500 proceeds to FIG. 5 c at block516. A Jamtrack is one type of musical piece that can be downloaded fromthe server 104.

To aid in the explanation of methods of the invention and associatedcontrol panel interfaces, some of the control panel graphical interfaceswill now be discussed. Referring now to FIG. 6 a, FIG. 6 a is ascreenshot particularly illustrating the control panel graphicalinterface for a guitar 600. As previously discussed, the applicationsoftware module 402 generates the control panel graphical interface 600,and in conjunction with the audio DSP software module 412, allows theuser to change the settings of the control panel graphical interface (orthe settings can be set to predefined settings determined by a sessionfile or a predefined patch) such that the audio DSP software module 412processes the audio signal from the guitar 112 to match the desiredsettings. The settings of the control panel graphical interface 600 fora guitar will now be described.

The control panel graphical interface 600 includes a plurality ofstandard control knobs 604 common to most guitar amplifiers including: adrive control knob 606, a bass control knob 608, a middle control knob610, a treble control knob 612, a presence control knob 614, and avolume control knob 616. These control knobs are selectable by the userto change the sound of the guitar. The control panel graphical interface600 further includes a boost switch 620 to increase the power of theaudio signal from the guitar. A bypass button 622 when selected turnsoff the DSP processing such that the straight unprocessed audio signalfrom the guitar is used. A compare button 624 when selected allows twodifferent control panel graphical interface configurations to becompared side by side. A collapse button 628 when selected reduces thesize of the control panel graphical interface 600. A mute guitar button630 when selected mutes the audio signal from the guitar.

The Master Volume dial 632 controls both the volume of the audio signalof the guitar 112 and the volume of any other audio signals (e.g. froman audio file) currently being processed. Selection of the hum reducerbutton 634 allows the user to reduce the hum interaction between theguitar 112 and the display device 204. Once the hum reducer button 634is selected and the learn button 636 is depressed, the computing device102 measures the hum interaction between the guitar 112 and the displaydevice 204 (e.g. the user can move his or her guitar next to the displaydevice) and DSP processing will compensate for the hum interaction andremove it. The noise gate button 638 when selected attenuates the inputaudio signal from the guitar, if it is below a threshold level, but doesnot attenuate the audio signal from the guitar if it is above thethreshold level. Thus, the noise gate button 638 may be used to get ridof such things as guitar handling noise. A guitar pan slide 640 may beused to pan the sound of the guitar between the left and right speakers.

Further, as previously discussed, the user may select a tone or a tonemay be automatically selected for the user to go along with the musicalpiece selected by the user. The type of tone selected is showing in thetone field 642. Any number of tones representing amplifier models basedon most any type of guitar amplifier (e.g. MARSHALL, FENDER, VOX,ROLAND, etc.), most any type of speaker cabinet, and most any type ofeffect can be reproduced. For example, tones for the Hells Bells rhythmsection by AC/DC, a heavy funk rock lead, a '64 Fender Deluxe, or anyother tone may be selected (e.g. see Top 10 Tones 685 (FIG. 6 b)) orcreated by the user. In particular, it should be appreciated that DSPalgorithms for altering the audio signals from a guitar 112 are known inthe art and can be easily implemented in software on a computing device102. For example, one example of DSP algorithms for altering the audiosignals from a guitar to model various amplifiers and speaker cabinetconfigurations which may be used in the audio DSP software module 412 toimplement aspects of the present invention is particularly described inU.S. Pat. No. 5,789,689 entitled “Tube Programmable Digital GuitarAmplification System”, which is hereby incorporated by reference.

Typically, a tone can be defined by the guitar amplifier, the speakercabinet, and a number of different effects, as well as other settings.Again the tone can be selected by the user, created by the user, or canbe preset to go along with the selected musical piece. The type ofguitar amplifier tone being modeled is shown in the amplifier modelfield 644 (e.g. '90 Marshall JCM-800). The speaker cabinet configurationtone being modeled is shown in the speaker cabinet model field 646 (e.g.4×12 '78 Marshall with Stock 70s). The speaker cabinet configuration 646emulates the effects of a speaker cabinet on the amplified guitar sound.Further, a number of a digitally reproduced well known effect boxes areprovided by the control panel graphical interface 600 to create tones.Particularly, a compression effect box 650, a delay effect box 652, amodulation effect box 654 (e.g. including chorus, flanger, rotary,tremolo, etc.), and a reverb effect box 656 are provided. Effect boxesare typically found in additional digital audio instrument processorsthat are coupled to a guitar and a standard amplifier. Also, thisparticular control panel graphical interface 600 shows that the delayeffect box 652 is currently selected and shows specific attributes ofthe delay effect such as delay time 660, feedback percentage 662, andlevel percentage 664. Moreover, as previously discussed, a user can logon to the GUITARPORT Web-site by selecting the GUITARPORT online button606.

Turning now to FIG. 6 b, FIG. 6 b is a screenshot of the displayillustrated to the user when they successfully log on to the server 104,according to one embodiment of the present invention Particularly, theapplication software module 402 and the embedded browser 404 display theGUITARPORT homepage 670 received from the server 104, which is locatedbelow the control panel graphical interface 600, and in conjunction withthe data received from the server 104, perform many of the functionsrequested by the user. It should be noted that control panel graphicalinterface 600 is the same as that shown in FIG. 6 a, except that in thisinstance, the compression effects box has been selected and acompression effects window (e.g. allowing for the selection of differentcompression ratios) is shown.

As shown in FIG. 6 b, the GUITARPORT homepage 670 includes a Home button671, a Features button 672, a News button 673, a Discussion button 674,a Users button 675, and a Guitar Tools button 676. When the home button671 is selected by a user, the user is returned to the GUITARPORThomepage. Depression of the Features button 672 brings the user to aFeatures page, which includes such things as interviews with artists,studio notes, and other articles related to the field of music that theuser may find useful. Selection of the News button 673 brings the userto a News page that provides news articles related to the field of musicand guitars in particular. When the user picks the Discussion button674, the user is brought to a bulletin board that allows users to postmessages (e.g. questions, answers, news, articles, etc.) in any subjectbut is usually related to music and guitars in particular. Selection ofthe Users button 675 provides the user with a user page that allows theuser to update their user profile (e.g. name, address, type ofsubscription, musical preferences, etc.). Depression of the Guitar Toolsbutton 676 brings the user to a utility page that provides the user withinformation related to guitar playing, for example: what is the figuringfor a C chord, how do I set up my amplifier, etc. This can beaccomplished by frequently asked questions (FAQ) listings, a searchabledatabase, email questions to a guitar technician, etc.

The GUITARPORT homepage can also be populated with selectable iconsrepresenting links to new articles, interviews, news, chords, guitarlicks, Newest Jamtracks (e.g. musical pieces), and the most popularTones. For example, FIG. 6 b shows selectable Studio Notes icon links678 and 679, a selectable Interview icon link 680, a selectable Today'sNews icon link 681, a Chord of the Week icon link 682, and a Lick of theWeek icon link 683, as well as, Newest Jamtracks (e.g. musical pieces)links 684, and Tone links 685. Moreover, as previously discussed, theGUITARPORT Web-site can be particularly tailored to a user based on userinformation (e.g. particularly the musical preferences of the user)stored in the user information database 109 at the server 104. With thisinformation, the server 104 can particularly tailor the GUITARPORTWeb-site to fit the musical preferences of the user. For example, if auser prefers rock-and-roll, then the Newest Jamtracks 684 (e.g. musicalpieces) will be directed towards rock-and-roll musical pieces as well asparticular Tones 685. Further, the other components of the GUITARPORTWeb-site can also be geared to the user's preference, for example,Studio Notes, Interviews, News, Chord of the Week, Lick of the Week,etc.

Further, the control panel graphical interface 600 has some selectablebuttons that interact with the Web-site. As shown in FIG. 6 b, theGUITARPORT online button 606 to connect to the GUITARPORT Web-site isalready depressed. An Artist and Gear button 687 is provided, and whenselected, provides a user a list of artists from which they can choose,such that the user can find articles written about the artist providingartist biographies and the type of musical gear that they use. Thetracks button 688 when selected, provides the user a list of musicalpieces (e.g. Jamtracks) that the user can select. In response to a userselecting a musical piece (e.g. Jamtrack), the server 104 transmits asession file associated with the selected musical piece to the computingdevice 102 through the computer network (e.g. the Internet) 105. Thesession file includes an audio file and multimedia data. The computingdevice 102 processes the session file to present a multimediapresentation of the audio file to the user, as will be discussed. TheTone button 689 when selected, provides the user a list of tones thatthe user can select. In response to a user selecting a tone, the server104 transmits patch information (e.g. type of amplifier, speakercabinet, effect settings, etc.) such that the control panel graphicalinterface 600 is properly configured and the DSP software module 412properly processes the guitar signal to emulate the proper tone.However, it should be appreciated that with or without a connection tothe GUITARPORT Web-site, the user can utilize previously stored tonesand musical pieces (e.g. Jamtracks).

Also, the control panel graphical interface 600 has a tuner button 690that when selected, allows the computing device to act as a chromatictuner such that user can tune his guitar. The control panel graphicalinterface 600 also has a Help button 691 that when selected providesstandard Help features to the user. Further, the control panel graphicalinterface 600 has standard Back and Forward arrows 692 and 693 thatallow the user to toggle back and forth through previously visited webpages of the GUITARPORT Web-site.

As previously discussed, if the user selects a Tone then the method 500proceeds to FIG. 5 b (block 514). For example, the user can select oneof the Tones provided by selecting the Tones button 689 or one of theTop Tones 685 (e.g. Heavy Funk Rock Lead (FIG. 6 b)). Turning to FIG. 5b, FIG. 5 b is a flowchart illustrating a method 501 of providing a toneto a user, according to one embodiment of the present invention. Inresponse to a user selecting a tone, the server 104 transmits patchinformation (e.g. type of amplifier, speaker cabinet, effect settings,etc.) to the computing device 102 (block 518). The application softwaremodule 402 sets the control panel graphical interface 600 to the properconfiguration to model the sound characteristics of the tone for themusical instrument (e.g. the guitar) (block 520). Further, the DSPsoftware module 412 properly processes the guitar audio signal toemulate the proper tone. Thus, the user can play his or her guitar 112connected through the interface device 106 to the computing device 102in the proper tone. For example, patches can represent guitar tones forvarious recording artists (e.g. Jimi Hendrix, Eric Clapton, JerryGarcia, Chet Atkins, Robert Cray, etc.) or can be particularly createdfor the GUITARPORT Web-site to represent various guitar styles-rock,country, jazz, etc.

As previously discussed, if the user selects a musical piece then themethod 500 proceeds to FIG. 5 c (block 516). For example, the user canselect one of the musical pieces (e.g. Jamtracks) provided by selectingthe Tracks button 688 or one of the Newest Jamtracks 684 (e.g. Welcometo the Jungle (FIG. 6 b)). Turning to FIG. 5 c, FIG. 5 c is a flowchartillustrating a method 503 of providing a musical piece to a useraccording to one embodiment of the present invention Particularly, inresponse to a user selecting a musical piece (e.g. Jamtrack), the server104 transmits a session file associated with the selected musical piece(e.g. Jamtrack) to the computing device 102 through the computer network(e.g. the Internet) 105 (block 524). The session file includes an audiofile and multimedia data.

Turning briefly to FIG. 5 d, FIG. 5 d illustrates the contents of asession file 539, according to one embodiment of the present invention.The session file 539 includes an audio file 540 associated with themusical piece (e.g. Jamtrack). The audio file 540 of the musical pieceis typically a song that the user wants to play along with. The audiofile 540 can be the full song (i.e. with all the instrument tracks andvocal tracks). Alternatively, the audio file 540 can have one or moretracks removed, for example: one or more guitar tracks can be removed,one or more vocal tracks can be removed, one or more bass tracks can beremoved, one or more drum tracks can be removed, etc. For example, aswill be discussed, the user can select a musical piece (e.g. Jamtrack)with the guitar track removed such that the audio file 540 is played bythe computing device 102 and the interface device 106 (e.g. through theamplified speakers 120), with the guitar track removed, so that the usercan play along with the song with the guitar track removed.

Further, the session file 539 has a multimedia block 542, which includesHTML data embedded with JavaScript to represent and display multimediainformation to the user. Particularly, with brief reference to FIG. 6 c,which will be discussed in more detail later, the multimedia data can beprocessed by the application software module 402 and the embeddedbrowser 404 of the computing device 102 (along with other softwaremodules of the computing device 102) to represent the name of the songor musical piece 601, and the music notation 603 associated with thelead sheet 605, such that the user can play along with the audio file540 being played. The multimedia data block 542 also includes all theother necessary data to achieve these functions.

The session file 539 also includes a patch block 544 that includes patchinformation such that the guitar 112 has the proper tone or sound to goalong with the associated selected musical piece/audio file 540. Thepatch information includes the type of amplifier, speaker cabinet,effect settings, etc., such that the guitar settings of the controlpanel interface 600 are set to go along with the selected musicalpiece/audio file. The application software module 402 sets the controlpanel graphical interface 600 to the proper configuration to model thesound characteristics of the tone for the guitar for the particularmusical piece/audio file 540. Further, the DSP software module 412properly processes the guitar signal to emulate the proper tone suchthat the guitar sound goes along with the musical piece/audio file 540.

Moreover, the session file 539 includes a MIDI file 546 that representsthe tempo changes, program changes, key signature changes, positionmarkers, etc., for the selected musical piece/audio file 540. MIDI filesare well known in the art. The computing device 102 (e.g. utilizing theapplication software module 402) interprets the tempo map from the MIDIfile during playback to convert the current audio playback position tothe corresponding audio file position in the MIDI file for the purposeof determining what events in the MIDI file should ram changes from theMIDI file are used to select patch information 544 to select amplifier,speaker cabinet, and effects settings, etc., for the amplifier controlsof the control panel graphical interface 600 that are needed for theparticular position in the audio file (e.g. the particular tone for theguitar being emulated using the DSP software module 412). Key signaturechanges from the MIDI file 546 are used for displaying the current keysignature to the user. Markers of the MIDI file 546 are used to causedisplay events at various points in the musical piece. Each marker inthe MIDI file 546 is assigned a text label. The label corresponds to aJavaScript function to be executed when the label is reached.

For example, turning briefly to FIG. 6 c, the musical piece (e.g.Jamtrack) LA Smooth Jazz in C 601, and it's associated lead sheet 605with musical notation 603 has been selected by user and is shown.Associated with the LA Smooth Jazz musical piece are MIDI markers. Thetext labels 609 for the MIDI markers 607 are displayed above the musicalnotation 603 and come from the MIDI file 546 of the session file 539. Inthis example, the text labels 609 of the MIDI markers 607 representdifferent portions of the musical piece/audio file 540, as shown: Intro,Verse, Bridge, Chorus, Solo 1, etc. For example, a MIDI marker 607 mayhave the text label 609 “Chorus”. The MIDI marker 607 for the text label609 “Chorus” causes the music notation 603 (e.g. chords, notes, guitartablature, and lyrics, etc.) to be displayed whenever the chorus of thesong begins. As another example, as shown in FIG. 6 c, the musicnotation 603 for the Intro (e.g. chords) is shown. Thus, when thecomputing device 102 receives a MIDI marker 607 from associated sessionfile 539, it processes the MIDI marker utilizing JavaScript, which looksup the corresponding function and executes the script for it. TheJavaScript typically loads a picture or draws something on the displaydevice. In this example, the JavaScript displays the musical notation603 (e.g. chords) for the Intro of the selected musical piece, LA SmoothJazz in C when it receives the MIDI marker 607 for the “Intro”.

Returning to FIG. 5 c, illustrating method 503, at block 528, thesession file 539 (e.g. the audio file 540 and the rest of the multimediadata) is processed to present a multimedia presentation of an audio file540 to the user (e.g. including musical notation 603). This allows theuser to play a guitar 112 in conjunction with the multimediapresentation of the audio file 540 (block 530).

Referring also to FIG. 6 c, the computing device 102 can displaypictures, text, and graphics during playback (e.g. on the display device204). For example, the computing device can display musical notation 603such that while the musical piece/Jamtrack (e.g. including audio file540) plays, the current position within the musical pieces is displayed,typically along with other information: such as the lyrics, the keysignature, and guitar tablature (e.g. chords, notes, figuring diagrams,etc.), and a user is allowed to play his or her guitar 112 inconjunction with the multimedia presentation of the audio file 540.

For example, in the present example of FIG. 6 c, the musical piece (e.g.Jamtrack) LA Smooth Jazz in C 601, and it's associated lead sheet 605with musical notation 603, has been selected by user and is display onthe Display 671. In this example, the text labels 609 of the MIDImarkers 607 are displayed and represent different portions of themusical piece/audio file 540, as shown: Intro, Verse, Bridge, Chorus,Solo 1, etc. As shown in FIG. 6 c, the music notation 603 for the Intro(e.g. chords) is shown. In this example, the JavaScript displays themusical notation 603 (e.g. chords) for the Intro of the selected musicalpiece, LA Smooth Jazz in C when it receives the MIDI marker 607 for the“Intro”.

Accordingly, the user can play his or her guitar 112 in conjunction withthe musical notation 603 and the audio file 540. As the audio file 540progresses, the musical notation 603 can be automatically updated (e.g.to next portion of the musical piece—Bridge, Chorus, solo, etc.) suchthat the user can read the musical notation and play along. Moreover,the user can choose versions of the musical piece/audio file 540 withand without a guitar track to enable learning and jamming. Further, aspreviously discussed, musical pieces/audio files can be chosen that havethe vocals, drums, bass, etc., removed.

Further, a patch block 544 that includes patch information such that theguitar 112 has the proper tone or sound to go along with the associatedmusical piece/audio file 540. The patch information includes the type ofamplifier, speaker cabinet, effect settings, etc., such that the guitarsettings of the control panel interface 600 are set to go along with theselected musical piece/audio file and can even accommodate changeswithin the musical piece itself. This can be triggered by the MIDImarkers, as previously discussed. The application software module 402sets the control panel graphical interface 600 to the properconfiguration to model the sound characteristics of the tone for theguitar for the particular musical piece or portion of the musical pieceand the DSP software module 412 properly processes the guitar signal toemulate the proper tone such that the guitar sound goes along with themusical piece/audio file 540. As previously discussed, the user's guitaris electrically routed through the computing device 102, allowing thecomputing device 102 to control the sound of a guitar during playback sothat the amplifier model, its settings and any effects can changedynamically as required throughout the musical piece/audio file 540. Asshown in FIG. 6 c, an amplifier model based on a '90 Marshall JCM-800amplifier with a Delay setting is used to emulate a jazz sound to goalong with the Intro. for the selected LA Smooth Jazz in C musicalpiece. Thus, matching patches for each portion of a musicalpiece/Jamtrack are automatically provided, for example to go from onetone during the Chorus and to another tone during the Solo.

Looking at FIG. 6 c, particular aspects of the Display 671 will bediscussed to point out other particular features of the invention. Asshown, the Tracks button 688 has been selected, and the musical piece LASmooth Jazz in C 601 has been particularly selected by the user.Accordingly, the LA Smooth Jazz in C's 601 associated lead sheet 605with musical notation 603 is further displayed on the Display 671. Belowthe selected musical piece (e.g. Jamtrack) LA Smooth Jazz in C 601 arebuttons that control the way musical pieces can be selected. The WebLoad button 611 allows a user to select a musical piece from theGUITARPORT Web-site and load it onto the user's computing device 102(e.g. store it in local memory). The Hard Disk button 613 allows a userto select a musical piece already stored locally at the computing device102 (e.g. on the user's hard disk). The CD button 615 allows a user toselect a musical piece from a CD in the CD drive of the user's computingdevice 102. When a song is selected on the CD, the server 104 determinesif it has an associated session file 539 for the song, and if so, if auser so chooses, provides the multimedia presentation of the song (e.g.patch file, musical notation, etc.) to the user.

The Jam button 617, when selected by the user, begins the multimediapresentation of a musical piece (e.g. Jamtrack), previously discussed,such that the user can jam along. The Mixer Slide 619 controls thevolume of the musical piece. The Autoselect On/Off button 621 can beused to toggle between using the pre-defined patch settings for thecontrol panel graphical interface 600 (i.e. the amplifier settings)automatically selected for the currently playing multimedia presentation(e.g. Autoselect On), as opposed to, the user setting the control panelgraphical interface 600 settings (i.e. the amplifier settings)themselves to their own liking (e.g. Autoselect Off).

A typical timer display 623 for musical pieces (e.g. Jamtracks) andloops is provided along with conventional digital multimedia controlfeatures 625 (e.g. play, record, stop, rewind, fast forward, etc.). ALick Learner button 627, when selected, slows down the tempo of thecurrently playing musical piece (e.g. Jamtrack), without altering thepitch, to facilitate learning. Also, a Loop button 629 is provided, thatwhen selected, loops (i.e. plays repeatedly), a current portion of amusical piece/Jamtrack (e.g. Intro, Chorus, etc.) to facilitate learningthat portion of the musical piece. Moreover, track details 631 can beselected which provides information about the musical piece. Forexample, when it was recorded, information about the artists, what typeof guitars, amplifiers, and effects that were used. Also, credits 633can be selected which provides information about where the musical piececame from, e.g. Sony, Arista, etc., or whether the musical piece wasspecifically created (and by who) for the GUITARPORT Web-site. Forexample, musical pieces (e.g. Jamtracks) can be custom-created tofacilitate the learning of particular types of music—e.g. rock, blues,jazz, country, etc.—exclusively for the GUITARPORT Web-site.

Accordingly, the present invention allows a user to couple his or herguitar 112 into the computing device 102, via the interface device 106,such that he or she can download tones and musical pieces from theGUITARPORT Web-site. The interface device 106 along with a subscriptionis required to obtain the online subscription services (e.g. downloadingthe musical pieces and tones). The interface device 106 uniquelyidentifies the user and, in conjunction with the rest of system 100, isused to authorize the user, encrypt and decrypt audio files, and totrack the purchases of assets, as will be discussed in more detaillater. Moreover, in response to a user selecting a musical piece (e.g.Jamtrack), the server 104 transmits a session file 539 associated withthe musical piece to the computing device 102 through the computernetwork 105. The session file 539 includes an audio file and multimediadata such that the computing device can process the session file topresent the multimedia presentation of the audio file to the user. Thecomputing device 102 processes the session file 539 to present themultimedia presentation of the audio file to the user (e.g. includingscrolling music notation 603) such that a user can play his or herguitar 112 in conjunction with the multimedia presentation of the audiofile. Furthermore, an intuitive control panel graphical interface 600for the guitar resembling familiar guitar equipment is provided. Thecontrol panel graphical interface 600 includes an amplifier panel withstandard controls, allowing the user to select from several differenttypes of amplifiers to achieve different tones. Also, a set of effectboxes is also provided.

As previously described, users can listen to musical pieces whileviewing musical notation 603 (e.g. chords, notes, tablature (fingeringdiagrams), lyrics, etc.). These musical pieces can include bothcommercial musical pieces and musical pieces created exclusively for useby the GUITARPORT Web-site to facilitate the learning of the guitar.Users can jam along with versions of a musical piece with and withoutthe original guitar track to facilitate practice. Thus, users areprovided quick and easy access to a wide variety of musical pieces (e.g.Jamtracks) that they can download from a server 104, and the user canthen play along with the downloaded musical piece, which is presented ina multimedia presentation format to facilitate learning.

Users can be provided with access to hundreds or thousands of musicalpieces (e.g. Jamtracks) in a range of different styles. Musical piecesmay include the following: pre-existing sound recordings; remixes ofpre-existing sound recordings (example without the guitar track or vocaltracks); re-recorded versions of previously published copyrighted songs;original songs produced for the GUITARPORT Web-site (e.g. songs createdto facilitate the learning of guitar); drum loops; grooves, etc.Furthermore, grooves (e.g. rhythm sections, drumbeats, etc.) can beprovided to facilitate jamming and practice. Moreover, the GUITARPORTWeb-site can also provide for the sale of many other music relatedassets, besides musical pieces (e.g. Jamtracks), such as: CDs by amultitude of recording artists, printed sheet music, tablature, guitarnotation, chord charts, lyrics, digital sheet music, T-shirts, musicmemorabilia etc. Additionally, as will be discussed in detail later,each unique musical piece or tone downloaded, or any type of purchase,is tracked and re-recorded for accurate reporting to content licensingpartners (e.g. the copyright owner).

Embodiments of the present invention further provide a security device110 to uniquely identify a user and to decrypt encrypted assets for useby the computing device 102. Thus, the security device protects againstunauthorized duplication of licensed material and provides a securerevenue opportunity for content providers. Typically assets relate tomusical pieces (e.g. Jamtracks) including audio files (e.g. copyrightedsound recordings), however, it should be appreciated that assets can beany sort of data (e.g. multimedia, video, movies, voice, software,generic data forms, etc.) transmitted over a computer network. As willbe discussed in more detail later, the security device 110 inconjunction with the computing device 102 and the server 104, allow theserver 104 to uniquely identify the security device 110 and allow acomputing device 102 coupled to the authorized security device 110 todecrypt assets specifically encrypted for use by the authorized securitydevice 110, along with many other functions. As will be discussed, thesecurity device 110 includes an embedded electronic Serial No. and userkey that is combined with hardware encryption and key storage circuitry,to uniquely identify each security device 110 to the server 104, and toensure that assets will only operate with a computing device 102 coupledto an authorized security device thereby providing a secure revenueopportunity for content providers.

Referring now to FIG. 7 a, FIG. 7 a illustrates a security system 700,according to one embodiment of the present invention. As previouslydiscussed, the server 104 is coupled through the computer network 105(e.g. the Internet) to the computing device 102, and the computingdevice 102 is in turn connected through an I/O link (e.g. a USB link) toa security device 110.

Shown to highlight the security aspects of the security system 700, theserver 104 includes the security software module 422, the applicationsoftware module 416, the server software module 415, the databasesoftware module 418 and, not shown here, the commerce software module420. Moreover, coupled to the server 104 through computer networkconnections are the asset database 107 and the user information database109.

Further shown to highlight the security aspects of the security system700, the computing device 102 includes the application software module402 including the security software module 408 and security hardwareinterface software 704. The security device 110 includes securityservices 706 and security components 710 to implement the securityservices 706. Moreover, local asset storage 712, for example localmemory such as a hard drive is coupled through I/O link 714 to thecomputing device 102 or is part of the computing device 102. Local assetstorage 712 can be used to store assets (e.g. audio files) previouslydownloaded by the user.

The security device 110 includes security components 710 that can beutilized to implement security services 706. Such security services 706include uniquely identifying the security device 110 to the server 104such that access to the server 104 is only granted to a user operatingwith an authorized security device 110. Another security service 706,performed by the security device 110 in conjunction with the server 104,is to ensure that assets (e.g. audio files) are properly encrypted anddecrypted such that only a computing device 102 coupled to properlyauthorized security device 110 can receive and utilize assets.

Looking particularly at the server 104, the server 104 includes thesecurity software module 422 that contains security programs andalgorithms for performing security functions, as will be discussed. Thesecurity software module 422 coordinates information from aclock/calendar of the server 104 and the various databases—i.e., theuser information database 109 and the asset database 107, toauthenticate users and deliver encrypted assets to authenticated users.The clock/calendar is a typical part of a server computer 104 thatallows it to accurately determine the date and time. Further, the server104 operates in secure operating environment (e.g. utilizing SecureSockets Layer (SSL), S-HTTP, etc).

The user information database 109 includes subscription and registrationinformation for each user who is registered to access the server 104(e.g. in one embodiment, a GUITARPORT Web-site subscriber) and who alsohas an authorized security device 110. The subscription information foreach user includes the expiration date for the user's subscription andthe user's unique serial number for his or her security device 110, userkey, and memory key, which are needed for determining the authenticityof each security device 110 and for encrypting and decrypting assets, aswill be discussed.

The asset database 107 contains assets (e.g. multimedia presentationsassociated with musical pieces and audio files as previously discussedJamtracks including full songs and songs with various instrumentaltracks removed), as well as any other sort of digital data asset.Moreover the asset database 107 includes unique asset encryption keysfor each asset (e.g. each audio file). Further, it should be appreciatedthat the asset database 107 can include any other assets that can bepurchased or rented and downloaded to a computing device 102 over acomputer network 105.

Looking particularly at the computing device 102, the computing device102 particularly includes the application software module 402 and thesecurity software module 408. The security software module 408 includesstandard encryption and decryption routines to encrypt and decryptassets, as will be discussed. Any suitable block mode cipher thatutilizes pseudo-random generators to XOR pseudo-random numbers with datacan be used. Some examples include Data Encryption Standard (DES),International Date Encryption Algorithm (IDEA), etc. Further, thesecurity software module 408, as will be discussed later, allows thecomputing device 102 to be used as a conduit for interaction between theserver 104 and the security device 110 and to particularly authenticatethe service device 110. However, the application software module 402 andthe security software module 408 are not assumed to execute in a secureoperating environment.

The security hardware interface software 704 provides a standardinput/output interface (e.g. a USB interface) between the computingdevice 102 and the security device 110. Furthermore, the computingdevice uses a standard clock/calendar (i.e. common to most all computingdevices) that allows the application software module 402 to accuratelydetermine the date and time for interactions between the computingdevice 102 and the security device 110.

Looking particularly at the security device 110 and referring now toFIG. 7 b, FIG. 7 b illustrates the pertinent security components 710 ofthe security device 110 according to one embodiment of the presentinvention. As shown in FIG. 7 b, the security device 110 includes amicroprocessor 340, a secure memory 379 having security logic 380,program storage 382 to store security firmware 383, and nonvolatilememory 384 (e.g. EEPROM). Also, an I/O controller 716 controls the flowof digital data to and from the computing device 102 along serial I/Olink 114. In one example, the serial I/O controller 716 can be a USBcontroller and the serial I/O link 114 can be a USB link. The digitaldata controlled by the serial I/O controller 716 can include keys, assetinformation and other data, as will be discussed.

Generally, the security firmware 383 when executed by the microprocessor340 in conjunction with the secure memory 379 and the nonvolatile memory384, provide for secure operations that allow the server 104 to uniquelyidentify the security device 110 and allow the computing device 102 inconjunction with the security device 110 to decrypt assets specificallyencrypted for use by a computing device 102 coupled to the authorizedcomputing device 102. The secure memory 379 includes both read-onlymemory (ROM) and writeable memory, which can be locked and unlocked forreading and writing using the hardware implemented security logic 380.

A user key 387 associated with serial number 386 of the security device110 is used by the security logic 380 to authenticate the securitydevice 110 to the server 104. Also, a memory key 389 is used by thesecurity logic 380 to initially unlock the secure memory 379. The serialnumber 386, user key 387, and memory key 389 are sealed in the securememory 379 during manufacturing and thereafter can no longer be writtenover once the secure memory 379 is sealed. The serial number 386, userkey 387, and memory key 389 are also stored at the server's userinformation database 109 so that the server 104 can initially generate achallenge and response to uniquely authenticate the security device 110and open and lock the secure memory 379 and the nonvolatile memory 384,as will be discussed in more detail later.

The nonvolatile memory 384 is used as an extension to the secure memory379. The firmware 383 prevents access to the nonvolatile memory 384unless the secure memory 379 has also been unlocked. The nonvolatilememory 384 has hardware write protection, which is controlled by thefirmware 383. The nonvolatile memory 384 stores keys 388 such as assetencryption keys (e.g. audio file keys) associated with particularpurchased assets (e.g. audio files), the current date and subscriptiondates for certain assets 390, and asset information (e.g. informationabout assets) 392. It should be appreciated that the serial number 386,the user key 387, the memory key 389, keys 388, the dates 390, the assetinformation 392 and even the firmware 383 can instead be located orco-located at any of the security device memories: program storage 382,secure memory 379, or nonvolatile memory 384; this particulararrangement being only one embodiment.

Moreover, as will be discussed, the security software of the server 104,computing device 102, and the firmware of the security device 110,include standard encryption and decryption routines to encrypt anddecrypt assets, keys, dates and other data sent between these devices.Any suitable block mode cipher that utilizes pseudo-random generators toXOR pseudo-random numbers with data can be used. Some examples includeData Encryption Standard (DES), International Date Encryption Algorithm(IDEA), etc.

Various security functions implemented by the combination of the server104, computing device 102, and security device 110, will now bediscussed with reference to the flowcharts of FIGS. 8 a–8 i.

One of the security functions to be performed is that the server 104uniquely identifies a security device 110 to ensure that the computingdevice 102 coupled to security device 110 is authorized to access theserver 104 and its many functions (e.g. in one embodiment, theGUITARPORT Web-site). Further, the server 104 determines theauthenticity of the security device 110 to prevent unauthorized accessto the server 104 and its assets (e.g. audio files). This is done when auser initially tries to log on to the server 104 and can be performedperiodically thereafter. This authentication process includes the server104 issuing a coded challenge to the security device via a scriptinglanguage performed by the security software module 422 of the server104. The firmware 383 of the security device 110 executes a program togenerate a response. An authorized security device 110 will return aunique response, which the server 104 utilizing the security softwaremodule 422 will validate. If the response is valid for the specificsecurity device 110, the session is continued. If the response is notvalid, the session is terminated.

Turning to FIG. 8 a, FIG. 8 a is a flow diagram illustrating a process800 for the server 104 to authenticate the security device 110,according to one embodiment of the present invention. These processsteps 800 are generally implemented by the security software module 422of the server 104 in conjunction with the other software modules at theserver. First, the server 104 requests the Serial No. 386 stored in thesecure memory 379 of the security device 110 from the security device110 (block 802). In response to the received Serial No., at block 803,the server determines whether the Serial No. is in the user informationdatabase 109. If not, the session is terminated (block 805). However, ifthe Serial No. is in the user information database 109, then the server104 obtains the user key for the Serial No. from the user informationdatabase 109 (block 806). As previously discussed, the user informationdatabase 109 stores a unique user key for each Serial No. associatedwith each security device 110. The server 104 also obtains a time anddate from the clock/calendar of the server 104, which will be used laterto see if the subscription is expired (block 808).

Next, the server 104 computes a challenge (block 810) and the expectedresponse from the security device 110 (block 812). The challenge isbasically a request for the security device 110 to accurately identifyitself by sending an appropriate response. The challenge is created atthe server 104 by performing a mathematical transformation on the userkey 387 associated with the security device 110. Both the server 104 andthe security device 110 utilize the same mathematical transformation andhave the same user key 387 such that the response generated at thesecurity device 110 should be the same as the response created at theserver 104 (assuming it actually is the security device associated withthe serial number for the user). In one embodiment, the commonmathematical transformation of the server 104 and security device 110can be any suitable one-way hashing function.

The challenge is then sent from the server 104 to the security device110 (block 814). The server 104 then waits for the response from thesecurity device 110 (block 816). If a predefined period of time passes,the process 800 is timed out, and the session is terminated (block 817).However, if a response is received within the predefined period of time,the server 104 determines whether the response from the security device110 matches the expected response (block 818). If not, the session isterminated (block 819). If so, the user is allowed to log on to theserver 104 and the process 800 is complete (block 821). For example, theuse can access the GUITARPORT Web-site, previously discussed.

Referring now to FIG. 8 b, FIG. 8 b is a flow diagram illustrating aprocess 822 for the security device 110 to respond to the authenticationchallenge from the server 104, according to one embodiment of thepresent invention. These process steps 822 are generally implementedunder the control of the firmware 383 of the security device 110. First,the user key 389 is obtained from the secure memory 379 (block 824).Next, at block 826, the response to the challenge is computed. Aspreviously described, the response is typically a mathematicaltransformation (e.g. a one-way hashing function), common to both theserver 104 and security device 110, of the user key 389 (again, commonto both the server 104 and security device 110). The response to thechallenge is then sent to the server 104 (block 828). The process 822 isthen complete (block 830).

Other security functions implemented by the combination of the server104, computing device 102, and security device 110, relate to updatingthe current date and the subscription expiration date stored at thesecurity device 110. The current date and the subscription expirationdate 390 are stored in nonvolatile memory 384 of the security device110. The server 104 updates both the subscription expiration date andthe current date 390 in the security device 110. However, theapplication software module 402 of the computing device 102 also updatesthe current date 390 when the server 104 is not connected. Because theapplication software module 402 is not considered secure, the server 104updates the subscription expiration date and the current date 390, whenit is connected, to maintain security.

Turning to FIG. 8 c, FIG. 8 c is a flow diagram illustrating a process832 for the server 104 to update the security device 110 with thecurrent date and the subscription expiration date, according to oneembodiment of the present invention. These process steps 832 aregenerally implemented by the security software module 422 of the server104 in conjunction with the other software modules at the server 104.First, the subscription expiration date from the user informationdatabase 109 is obtained for the user (block 834). Next, the currentdate from the clock/calendar of the server 104 is obtained (block 836).The subscription expiration date and the current date are then encrypted(block 838). Further, the server 104 sends a command to the securitydevice 110 to unlock the security device memory 721 including thenonvolatile memory 384 (block 840). FIG. 8 d, as will be discussed,describes the process of unlocking the security device memory 721. Basedon a response from the security device 110 as to whether the securitydevice memory 721 has been successfully unlocked, the server 104determines whether the unlock operation was successful or not (block842). If the security device memory 721 was not successfully unlocked,the process 832 fails (block 844).

However, if the security device memory 721 was successfully unlocked,then the server 104 sends the encrypted subscription expiration date andthe current date to the security device 110 where the security device110 updates the dates (block 846). FIG. 8 e, as will be discussed,describes the process of the security device 110 updating the dates. Theserver then sends a command to the security device to lock the securitydevice memory 721 (block 848). FIGS. 8 f and 8 g, as will be discussed,describe the process of locking the security device memory 721. Theprocess 832 is then complete (block 850).

Referring to FIG. 8 d, FIG. 8 d is a flow diagram illustrating a process852 for the server 104 to unlock the security device memory 721 of thesecurity device 110, according to one embodiment of the presentinvention. At block 854 the server 104 obtains the Serial No. 386 fromthe security device 110. Next, at block 856 the server obtains thememory key 389 associated with the Serial No. for the user from the userinformation database 109. The server 104 then obtains the current timeand date from the clock/calendar of the server 104 (block 858). Theserver then obtains the current cryptogram from the security device 110(block 860). The current cryptogram is a random number generated by thesecurity device 110 each time the security device 110 is authenticatedby the server 104.

The server 104 next computes an unlock message to unlock the securitydevice memory 721 and an appropriate expected response value from thesecurity device 110 (block 862). Then, the server 104 sends the memoryunlock message to the security device 110 (block 864).

If the unlock message is valid, i.e. decipherable by the security device110 to properly command the security device 110 to unlock its securitydevice memory 371 (such that both the security device and the servermust be authorized participants), the security device 110 will send theexpected response back to the server 104. The server 104 requires anappropriate expected response back from the security device 110 toverify that it is the authorized security device 110 and that thesecurity device memory 371 has therefore been unlocked. Conversely, thesecurity device 110, based on the unlock message, can verify that theserver 104 is authorized to command the security device to unlock itssecurity device memory 371. The symmetrical expected response generatedat the server 104 and the response generated at the security device 110,utilizing the memory key 389 and the cryptogram, in one embodiment, canbe based upon a proprietary anti-wire tapping algorithm created andlicensed by the ELVA Corporation. However, any suitable zero-knowledgeproof algorithm for accurately authenticating two parties can be used.Furthermore, in one embodiment, the security logic 380 that implementsthe ELVA anti-wire tapping algorithm may be a cryptography deviceproduced by the ATMEL Corporation.

Continuing with the present example, the server 104 waits for anappropriate response from the security device 110 for a predefinedperiod of time (block 866). If the security device 110 does not respondwith a predefined period of time then the process 852 fails (block 868).If the server 104 receives a response from the security device 110 intime, then at block 870, the server 104 determines whether it hasreceived the expected response from the security device 110. If not, theprocess 852 fails (block 872). If the server 104 receives the expectedresponse from the security device 110, then the server 104 knows thatthe security device memory 721 of the security device 110 has beenunlocked. Accordingly, as will be discussed with reference to FIG. 8 e,the memory is unlocked such that the security device can update thecurrent and subscription expiration dates received from the server 104.The process 852 is then complete (block 873). Moreover, it should beappreciated that the security device memory 721 can be unlocked toperform many other functions, for example, to store asset information392, asset keys 391, etc., as will be discussed.

Referring to FIG. 8 e, FIG. 8 e is a flow diagram illustrating a process874 for the security device 110 to update the current and subscriptionexpiration dates received from the server 104, according to oneembodiment of the present invention. Again, the security device operatesunder the control of the firmware 383 to implement its functions. Atblock 876 the security device 110 decrypts the current date and thesubscription expiration date received from the server 104. Next, atblock 878, the security device 110 stores the current date and thesubscription expiration date 390 in nonvolatile memory 384. The process874 is then complete (block 880).

Referring to FIG. 8 f, FIG. 8 f is a flow diagram illustrating a process882 for the server 104 to lock the nonvolatile memory 384 of thesecurity device memory 721 of the security device 110, according to oneembodiment of the present invention. In order to accomplish this, theserver 104 merely sends a memory lock command to the security device 110(block 884). The process 882 is then complete (block 886).

After the server 104 sends a memory lock command to lock the nonvolatilememory 384, the security device 110 can lock the secure memory 379.Turning now to FIG. 8 g, FIG. 8 g is a flow diagram illustrating aprocess 888 for the security device 110 to lock the secure memory 379,according to one embodiment of the present invention. At block 890, thesecurity device 110 determines whether the secure memory 379 isunlocked. If not, indicating that the secure memory 379 is alreadylocked, the process 888 is complete (block 899). If the secure memory379 is unlocked, the security device 110 checks to see whether the lockmemory command has already been received (block 892). If so, thesecurity device 110 locks the secure memory 379 and the security logic380 (block 894) and disables access to the nonvolatile memory 384 (block898). The process 888 is then complete (block 899).

However, if the lock memory command has not been received at block 892then the security device 110 checks to see whether the memory unlocktime has been exceeded. If not, the process 888 is complete and thesecurity device 110 can lock the security device memory 721 later (block899). On the other hand, if the memory unlock time has been exceeded,then the security device 110 locks the secure memory 379 and thesecurity logic 380 (block 894) and disables access to the nonvolatilememory 384 (block 898) such that the process 888 is then complete (block899). Accordingly, once the secure memory 379 is locked, as well as, thenonvolatile memory 384, the whole security device memory 721 is locked.Thus, after the security device memory 721 has been unlocked to updatethe current and subscription expiration dates, to store assetinformation 392, asset keys 391, etc., it can be locked again.

As previously discussed, the application software module 402 and thesecurity software module 408 of the computing device 102 can be used toupdate the current date and time in the security device 110. However,this is not secure, and these dates and times are always scrutinizedagainst the dates and times received from the server 104 as previouslydiscussed.

Referring now to FIG. 8 h, FIG. 8 is a flow diagram illustrating aprocess 801 for the application software module 402 of the computingdevice 102, in conjunction with the other software modules, to updatethe current date at the security device 110, according to one embodimentof the present invention. At block 805 the computing device 102determines whether the security device 110 is requesting the date andtime. If not, the process 801 is complete (block 807). However, if thesecurity device 110 is requesting the date and time, then the computingdevice 102 obtains the date and time from the clock/calendar of thecomputing device 102 (block 809). The computing device 102 then sendsthe date and time to the security device 110 (block 811). The process801 is then complete (block 813).

Turning now to FIG. 8 i, FIG. 8 i is a flow diagram illustrating aprocess 815 for the security device 110 to update the current date andtime received from the computing device 102, according to one embodimentof the present invention. At block 823, the security device 110determines whether the current date received is beyond the subscriptionexpiration date. If so, the security device 110 records the expirationof the subscription (e.g. in nonvolatile memory 384) (block 825). Theprocess 815 is then complete (block 827). The security device 110 maythen instruct the computing device 102 to display to the user that hisor subscription has expired and the server 104 will direct the user toupdate the subscription upon the next connection.

On the other hand, if the current date is not beyond the subscriptionexpiration date, the security device 110 will check to see that the datereceived from the application software module 402 of the computingdevice 102 is valid as compared to the trusted date and time receivedfrom the server 104 from the last update (block 829). If not, thesecurity device 110 will then assume there has been a breach of securityand will record the expiration of the subscription (block 825). Theprocess 815 is then complete (block 827). Again, the security device 110may then instruct the computing device 102 to display to the user thathis or subscription has expired and the server 104 will direct the userto update the subscription upon the next connection. However, if thedate from the application software module 402 of the computing device102 is determined to be valid by the security device 110 then thesecurity device will then store the date and time 390 in the nonvolatilememory 384 (block 831). The process 815 is then complete (block 833).

Another security service 706, performed by the security device 110 inconjunction with the server 104, is to ensure that digital assets (e.g.audio files) are properly encrypted and decrypted such that only acomputing device 102 coupled to properly authorized security device 110can receive and utilize the assets. As previously discussed, the assetdatabase 107 contains assets (e.g. multimedia presentations associatedwith musical pieces, audio files (e.g., as previously discussedJamtracks including full songs and songs with various instrumentaltracks removed), as well as other digital data assets. Moreover theasset database 107 includes unique asset encryption keys for each asset(e.g. for each audio file). Further, it should be appreciated that theasset database 107 can include any other type of digital data asset(e.g. multimedia data, video data, voice data, software, other genericforms of data, etc.) that can be purchased or rented and downloaded to acomputing device 102 coupled to an authorized security device 110 over acomputer network 105. Thus, the term “asset” as it will be usedhereinafter specifically includes audio files (e.g. such as theJamtracks previously discussed with reference to the GUITARPORTWeb-site) but further includes any other sort of digital asset.

Embodiment of the present invention further provides a secure assetdelivery system. Assets are encrypted by the security system 700(referring also to FIG. 7 a again) to protect against unauthorizedduplication of licensed material. Each asset is stored in the assetdatabase 107 of the server 104 and is encrypted with a different, uniqueasset key particularly for that asset. Each asset is uniquely encryptedutilizing the security software module 422 of the server 104, inconjunction with the other software modules. As each encrypted asset isstreamed to the requesting computing device 102, the encrypted asset isstored in the asset storage 712 of the computing device 102. Further,the asset key for the asset is encrypted using the user key of theassociated security device 100 of the requesting computing device 102,and the encrypted asset key is also streamed to the requesting computingdevice 102, where it is stored in the asset storage 712 of the computingdevice 102. As previously discussed each user key 389 is unique to eachuser's security device 110 and each user key 389 is stored at both thesecurity device 110 and at the user information database 109 at theserver 104.

When it is time to access the asset at the computing device 102, forexample, the user wants to play a downloaded audio file asset (e.g. aspart of a multimedia presentation for a Jamtrack to facilitate learningof the guitar), the security software module 408 in conjunction with theapplication software module 402 and the other software modules of thecomputing device 102, sends the encrypted asset key to the securitydevice 110 to be decrypted. The decrypted asset key is then sent backfrom the security device 110 to the computing device 110 where it isused by the computing device 102, operating again with the securitysoftware module 408 in conjunction with the application software module402 and the other software modules, to decrypt the asset (e.g. an audiofile) into memory. The decrypted asset can then be utilized. Forexample, a decrypted audio file can be decompressed for playback.

Referring now to FIG. 9, FIG. 9 illustrates an example of a secure assetdelivery system 900, as previously described, according to oneembodiment of the present invention. At block 902, an asset (A) 904 isencrypted with an asset key (AK) 906. The encrypted asset 905 (e.g.(E_(AK)(A))) is then sent to the computing device 102 where it is storedin memory (e.g. asset storage 712) (block 910). Also, at block 920 theasset key (AK) 906 is encrypted with the user's user key (UK) 389. Theencrypted asset key 909 (e.g. (E_(UK)(AK))) is then sent to thecomputing device 102 where it is stored in memory (block 924). At block930, the security device 110 decrypts the encrypted asset key 909 withthe user's unique user key (UK) 389 (e.g. D_(UK)[E_(UK)(AK)]) to yieldthe asset key 906 (AK), which is then forwarded onto the computingdevice 102. Then, at block 932, the computing device 102 can decrypt theencrypted asset 905 with the asset key (AK) 906 (e.g. D_(AK)[E_(AK)(A)])to yield the asset (A). The asset can then be utilized by theapplication software module 402 of the computing device 102. Forexample, if the asset is an audio file, the audio file can bedecompressed for playback as part of a multimedia presentation of aJamtrack to facilitate learning of guitar. It should be appreciated thatencryption and decryption algorithms are well known in the art, and thatvarious types of encryption and decryption algorithms can be used by theserver 104, the computing device 102, and the security device 110.

The security software of the server 104, computing device 102, and thefirmware of the security device 110, include standard encryption anddecryption routines to encrypt and decrypt assets, keys, dates and otherdata sent between these devices. Any suitable block mode cipher thatutilizes pseudo-random generators to XOR pseudo-random numbers with datacan be used. Some examples include Data Encryption Standard (DES),International Date Encryption Algorithm (IDEA), etc.

A more detailed embodiment of the secure asset delivery system 900,according to one embodiment of the present invention, will now bediscussed. As previously discussed, the server 104 encrypts each assetsent to a user with a unique asset key. Moreover, the server 104 alsosends an indication as to whether the asset is to be rented or owned bythe user. Assets that are rented expire when the user's subscriptionexpires and cannot be used after the subscription. Assets that are ownedby the user do not expire when the user's subscription expires. Theserver 104 further sends the unique asset key required to decrypt theasset to the user in an encrypted form—wherein the asset key isencrypted with the user key 389 of the security device 110 for the usersuch that the security device 110 can decrypt the encrypted asset keyand the computing device 102 can then decrypt the asset with thedecrypted asset key to provide the user access to the asset. Thus, anasset can be delivered securely to a specific user having a particularsecurity device.

The computing device 102, operating with the application software module402, the security software module 408 and in conjunction with the othersoftware modules, performs many functions related to decrypting andaccessing the asset, as has been previously discussed. The computingdevice 102 receives and stores the encrypted asset and the encryptedasset key in local memory (e.g. asset storage 712). The computing device102 sends the encrypted asset key (and an indication of whether theasset is rented our owned) to the security device 110. The securitydevice 110, under control of the firmware 383, decrypts the asset keyand determines whether the asset has expired due to a lapsedsubscription. If the asset has not expired, the security device 110sends the decrypted asset key to the computing device 102 so that theasset can be decrypted by the computing device and can then be utilized.As previously discussed, the computing device 102 decrypts the assetwith the asset key to yield the asset.

On the other hand, if the subscription has expired, the security device110 notifies the computing device 102, and the computing device 102notifies the user that the subscription has expired. Specific processsteps will now be discussed to implement this functionality.

Referring to FIG. 10 a, FIG. 10 a is a flow diagram illustrating aprocess 1000 for the server 104 to encrypt assets, according to oneembodiment of the present invention. The server 104 operates under thecontrol of the application software module 416, the security softwaremodule 422 and in conjunction with the other software modules, toimplement the functions of the processes, as will be discussed. At block1002, the server 104 obtains the time and date from the clock/calendarof the server 104. Next, the server 104 generates an encryption key(block 1004). The server 104 then encrypts the asset with a unique assetkey (block 1006). The server 104 then stores the encrypted asset and theasset key in the asset database 107 (block 1008). The process 1000 isthen complete (block 1010).

Referring now to FIG. 10 b, FIG. 10 b is a flow diagram illustrating aprocess 1012 for the server 104 to deliver the asset, according to oneembodiment of the present invention. At block 1014, the server 104obtains the asset, the asset key, and a status indication of whether theasset is owned or rented from the asset database 107. The statusindication may be implemented as a rental flag—e.g. a rental flag thatis set corresponds to the asset being rented by the user and a rentalflag that is not set corresponds to the asset being owned or purchasedby the user. Further, the server 104 obtains the user key 389 for theuser (corresponding to the user's security device 110) from the userinformation database 109 (block 1016). Next, the server 104 encrypts theasset key and the rental flag utilizing the user's user key 389 (block1018). The server 104 then sends the encrypted asset key and rental flagto the computing device 102 (block 1020). Further, the server 104 sendsthe encrypted asset to the computing device 102 (block 1022). Theprocess 1012 is then complete (block 1024).

Turning now to FIG. 10 c, FIG. 10 c is a flow diagram illustrating aprocess 1026 by which the computing device 102 performs the functions ofextracting the asset key from the security device 110, according to oneembodiment of the present invention. The computing device 102 operatesunder the control of the application software module 402, the securitysoftware module 408 and in conjunction with the other software modules,to implement the functions of the processes, as will be discussed. Atblock 1028, the computing device 102 sends the encrypted asset key andrental flag received from the server 104 to the security device 110.Next, the computing device 102 obtains a response from the secure device110 (block 1030). The response includes a notification as to whether theasset has expired, and if the asset has not expired, the decrypted assetkey. The generation of the response at the security device 110 will bediscussed later with reference to FIG. 10 e.

At block 1032, the computing device 102 determines, based on theresponse from the security device 110, whether access to the asset hasexpired (block 1032). For example, if the asset is rented and thesubscription has expired (i.e. the current date is passed thesubscription expiration date for the asset), then access to the assethas expired. Thus, if access to the asset has expired, then at block1034, the computing device 102 notifies the user that access to theasset has expired. If access to the asset has not expired (i.e. theasset is owned or the subscription expiration date has not passed), thenthe computing device extracts the asset key from the security deviceresponse (block 1036). The process 1026 is then complete (block 1038).

Referring now to FIG. 10 d, FIG. 10 d is a flow diagram illustrating aprocess 1040 by which the computing device 102 performs the functions ofdecrypting the asset, according to one embodiment of the presentinvention. At block 1042, the computing device 102 initializes adecryption algorithm with the asset key received from the securitydevice 110. Next, the computing device 102 loads the encrypted assetinto memory (block 1044). The computing device 102 then decrypts thememory copy of the encrypted asset utilizing the asset key received fromthe security device 110 to decrypt the encrypted asset (i.e. theencrypted asset being encrypted with the asset key) (block 1046). Thus,the asset is yielded to the computing device 102, for use by thecomputing device 102. The asset can then be utilized by applications ofthe computing device 102. For example, if the asset is an audio file,the audio file can be decompressed for playback as part of a multimediapresentation of a Jamtrack to facilitate the learning of guitar, aspreviously discussed.

Turning now to FIG. 10 e, FIG. 10 e is a flow diagram illustrating aprocess 1050 by which the security device 110 extracts the asset key,according to one embodiment of the present invention. As previouslydiscussed, the security device 110 operates under the control of thefirmware 383. At block 1052, the security device 110 receives theencrypted asset key and the rental flag from the computing device 102.The encrypted asset key and rental flag being encrypted with the userkey. The security device 110 then obtains the user key 389 fromnonvolatile memory 384 (block 1054). Next, the security device 110decrypts the asset key and rental flag with the user key 389 (block1056).

The security device then determines whether the asset is rented (block1058). If not (i.e. it is owned), the security device 110 returns thedecrypted asset key to the computing device 102 (block 1060) and process1050 is complete (block 1068). However, if the asset is rented, thesecurity device 110 next determines whether the subscription has expired(i.e. whether the current date is passed the subscription expirationdate for the asset) (block 1062). If not, the security device 110returns the decrypted asset key to the computing device 102 (block 1060)and the process 1050 is complete (block 1068). However, if thesubscription has expired, then the security device 110 returns aresponse with an indication to the computing device 102 that thesubscription has expired (block 1064). The process 1050 is then complete(block 1068).

It should be appreciated that the security software of the server 104,computing device 102, and the firmware of the security device 110,utilize standard encryption and decryption routines to encrypt anddecrypt assets, keys, dates and other data sent between these devices,as has been discussed. Any suitable block mode cipher that utilizespseudo-random generators to XOR pseudo-random numbers with data can beused. Some examples include Data Encryption Standard (DES),International Date Encryption Algorithm (IDEA), etc.

Accordingly, as previously described, the secure asset delivery systemensures that digital assets are encrypted and decrypted such that only acomputing device coupled to properly authorized security device, that isassociated with a particular user/subscriber, can receive and utilizethe assets. Embodiments of the present invention provide a secure assetdelivery system wherein digital assets are properly encrypted by thesecure server 104 and can only be decrypted by a computing device 102that is coupled to a properly authorized security device 110 such thatonly that properly authorized computing devices 102 can receive andutilize the assets—thereby protecting against unauthorized duplicationof licensed material. As previously discussed, in one embodiment, theasset database 107 contains assets (e.g. multimedia presentationsassociated with musical pieces, audio files—such as Jamtracks includingfull songs and songs with various instrumental tracks removed)), as wellas other digital assets. For example, in one embodiment, if the asset isan audio file, the audio file can be decompressed for playback as partof a multimedia presentation of a Jamtrack to facilitate the learning ofguitar, as previously discussed. Further, it should be appreciated thatthe asset database 107 can include any other digital assets (e.g.multimedia, videos, movies, voice, sound recordings, software, othergeneric forms of data etc.) that can be purchased or rented anddownloaded to a computing device 102 over a computer network 105.

The various aspects of the previously described inventions can beimplemented as one or more instructions (e.g. software modules,programs, code segments, etc.) to perform the previously describedfunctions. The instructions which when read and executed by a processor,cause the processor to perform the operations necessary to implementand/or use embodiments of the invention. Generally, the instructions aretangibly embodied in and/or readable from a machine-readable medium,device, or carrier, such as memory, data storage devices, and/or remotedevices. The instructions may be loaded from memory, data storagedevices, and/or remote devices into the memory of the computing device102, server 104, and interface device 106 for use during operations. Theinstructions can be used to cause a general purpose or special purposeprocessor, which is programmed with the instructions to perform thesteps of the present invention. Alternatively, the features or steps ofthe present invention may be performed by specific hardware componentsthat contain hard-wired logic for performing the steps, or by anycombination of programmed computer components and custom hardwarecomponents. While, embodiments of the present invention have beendescribed with reference to the World-Wide Web, the methods, systems,and apparatuses described herein are equally applicable to other networkinfrastructures or other data communications systems.

While the present invention and its various functional components havebeen described in particular embodiments, it should be appreciated theembodiments of the present invention can be implemented in hardware,software, firmware, middleware or a combination thereof and utilized insystems, subsystems, components, or sub-components thereof. Whenimplemented in software (e.g. as a software module), the elements of thepresent invention are the instructions/code segments to perform thenecessary tasks. The program or code segments can be stored in a machinereadable medium, such as a processor readable medium or a computerprogram product, or transmitted by a computer data signal embodied in acarrier wave, or a signal modulated by a carrier, over a transmissionmedium or communication link. The machine-readable medium orprocessor-readable medium may include any medium that can store ortransfer information in a form readable and executable by a machine(e.g. a processor, a computer, etc.). Examples of themachine/processor-readable medium include an electronic circuit, asemiconductor memory device, a ROM, a flash memory, an erasableprogrammable ROM (EPROM), a floppy diskette, a compact disk CD-ROM, anoptical disk, a hard disk, a fiber optic medium, a radio frequency (RF)link, etc. The computer data signal may include any signal that canpropagate over a transmission medium such as electronic networkchannels, optical fibers, air, electromagnetic, RF links, etc. The codesegments may be downloaded via computer networks such as the Internet,Intranet, etc.

While this invention has been described with reference to illustrativeembodiments, this description is not intended to be construed in alimiting sense. Various modifications of the illustrative embodiments,as well as other embodiments of the invention, which are apparent topersons skilled in the art to which the invention pertains are deemed tolie within the spirit and scope of the invention.

1. A method to deliver a multimedia presentation of an audio file to auser that allows the user to play a musical instrument in conjunctionwith the multimedia presentation, the method comprising: in response toa user selecting a musical piece, transmitting a session file associatedwith the musical piece, the session file including an audio file andmultimedia data; processing the session file utilizing a computingdevice to present a multimedia presentation of the audio file to theuser; coupling the musical instrument to the computing device such thatan audio signal from the musical instrument generated responsive to auser playing the musical instrument is transmitted to the computingdevice; displaying a control panel graphical interface including anamplifier for a musical instrument, the control panel graphicalinterface having settings that define sound characteristics for themusical instrument to alter the audio signal; and creating a mixedsignal that combines the altered audio signal with the audio file, themixed signal being transmitted through a sound device such that the usercan play the musical instrument in conjunction with the multimediapresentation of the audio file.
 2. The method of claim 1, wherein thecontrol panel graphical interface allows the user to set the soundcharacteristics for the musical instrument.
 3. The method of claim 1,wherein the multimedia data of the session file sets the control panelgraphical interface to pre-defined values to model the soundcharacteristics of the musical instrument associated with the audio filefor the musical piece selected by the user.
 4. The method of claim 1,further comprising removing a track associated with the user's musicalinstrument from the audio file for the musical piece selected by theuser such that the user can play the user's musical instrument inconjunction with a multimedia presentation of the audio file that doesnot include the user's musical instrument.
 5. The method of claim 1,further comprising displaying music notation associated with the audiofile of the musical piece selected by the user in the multimediapresentation to the user.
 6. The method of claim 1, further comprisingidentifying the user based upon a unique identifier.
 7. The method ofclaim 6, wherein the unique identifier is a serial number.
 8. The methodof claim 6, further comprising tailoring a presentation of musicalpieces to the user based upon the unique identifier.
 9. The method ofclaim 6, further comprising storing a user key.
 10. The method of claim9, further comprising: encrypting the audio file transmitted to thecomputing device of the user with an audio file key associated with theaudio file; and encrypting the audio file key with the user key for theuser.
 11. The method of claim 10, further comprising: decrypting theaudio file key that is encrypted with the user key using the stored userkey; and decrypting the audio file with the decrypted audio file key.12. The method of claim 1, wherein the musical instrument is amicrophone.
 13. The method of claim 1, wherein the musical instrument isa guitar.
 14. The method of claim 13, wherein the multimedia data of thesession file sets the control panel graphical interface to pre-definedvalues to model the sound characteristics of the guitar associated withthe audio file for the musical piece selected by the user.
 15. Themethod of claim 14, further comprising removing a guitar track from theaudio file for the musical piece selected by the user such that the usercan play the user's guitar in conjunction with a multimedia presentationof the audio file that does not include the guitar track.
 16. The methodof claim 14, further comprising displaying music notation for a guitarassociated with the audio file of the musical piece selected by the userin the multimedia presentation to the user.
 17. A system to deliver amultimedia presentation of an audio file to a computing device fordisplay to a user that allows the user to play a musical instrument inconjunction with the multimedia presentation, the system comprising: aserver to transmit a session file to the computing device through acomputer network in response to a user selecting a musical piece, thesession file associated with the selected musical piece, the sessionfile including an audio file and multimedia data such that the computingdevice processes the session file to present the multimedia presentationof the audio file to the user; and an interface device connected to thecomputing device and the user's musical instrument, the interface deviceto couple the musical instrument to the computing device such that anaudio signal is generated responsive to a user playing the musicalinstrument that is transmitted to the computing device; and wherein acontrol panel graphical interface including an amplifier for a musicalinstrument is displayed by the computing device, the control panelgraphical interface having settings that define sound characteristicsfor the musical instrument to alter the audio signal; wherein a mixedsignal is created that combines the altered audio signal with the audiofile, the mixed signal being transmitted through a sound device suchthat the user can play the musical instrument in conjunction with themultimedia presentation of the audio file.
 18. The system of claim 17,wherein the control panel graphical interface allows the user to set thesound characteristics for the musical instrument.
 19. The system ofclaim 17, wherein the multimedia data of the session file sets thecontrol panel graphical interface to pre-defined values to model thesound characteristics of the musical instrument associated with theaudio file for the musical piece selected by the user.
 20. The system ofclaim 17, wherein a track associated with the user's musical instrumentis removed from the audio file of the musical piece selected by the usersuch that the user can play the user's musical instrument in conjunctionwith a multimedia presentation of the audio file that does not includethe user's musical instrument.
 21. The system of claim 17, wherein themultimedia data of the session file causes the display of music notationassociated with the audio file of the musical piece selected by theuser.
 22. The system of claim 17, wherein the server identifies the userbased upon a unique identifier stored in the interface device.
 23. Thesystem of claim 22, wherein the unique identifier stored in the user'sinterface device is the serial number associated with the interfacedevice.
 24. The system of claim 22, wherein the server tailors apresentation of musical pieces to the user based upon the uniqueidentifier.
 25. The system of claim 22, wherein the interface devicestores a user key associated with the interface device.
 26. The systemof claim 25, wherein the audio file transmitted from the server to thecomputing device of the user is encrypted with an audio file keyassociated with the audio file and the audio file key is encrypted withuser key for the user and is also transmitted to the computing device.27. The system of claim 26, wherein the interface device decrypts theaudio file key that is encrypted with the user key using the stored userkey and transmits the decrypted audio file key to the computing devicesuch that the computing device uses the decrypted audio file key todecrypt the audio file.
 28. The system of claim 17, wherein the musicalinstrument is a microphone.
 29. The system of claim 17, wherein themusical instrument is a guitar.
 30. The system of claim 29, wherein themultimedia data of the session file sets the control panel graphicalinterface to pre-defined values to model the sound characteristics ofthe guitar associated with the audio file for the musical piece selectedby the user.
 31. The system of claim 30, wherein a guitar track isremoved from the audio file of the musical piece selected by the usersuch that the user can play the user's guitar in conjunction with amultimedia presentation of the audio file that does not include theguitar track.
 32. The system of claim 30, wherein the multimedia data ofthe session file causes the display of music notation for a guitarassociated with the audio file of the musical piece selected by theuser.
 33. A computer-readable medium having stored thereon instructions,which when executed by a computer, cause the computer to perform thefollowing operations comprising: in response to a user selecting amusical piece, transmitting a session file associated with the musicalpiece, the session file including an audio file and multimedia data;processing the session file to present a multimedia presentation of theaudio file to the user; and processing a musical instrument's signalsuch that an audio signal from the musical instrument is generatedresponsive to a user playing the musical instrument; displaying acontrol panel graphical interface including an amplifier for a musicalinstrument, the control panel graphical interface having settings thatdefine sound characteristics for the musical instrument to alter theaudio signal; and creating a mixed signal that combines the alteredaudio signal with the audio file, the mixed signal being transmittedthrough a sound device such that the user can play the musicalinstrument in conjunction with the multimedia presentation of the audiofile.
 34. The computer-readable medium of claim 33, wherein the controlpanel graphical interface allows the user to set the soundcharacteristics for the musical instrument.
 35. The computer-readablemedium of claim 33, wherein the multimedia data of the session file setsthe control panel graphical interface to pre-defined values to model thesound characteristics of the musical instrument associated with theaudio file for the musical piece selected by the user.
 36. Thecomputer-readable medium of claim 33, further comprising removing atrack associated with the user's musical instrument from the audio filefor the musical piece selected by the user such that the user can playthe user's musical instrument in conjunction with a multimediapresentation of the audio file that does not include the user's musicalinstrument.
 37. The computer-readable medium of claim 33, furthercomprising displaying music notation associated with the audio file ofthe musical piece selected by the user in the multimedia presentation tothe user.
 38. The computer-readable medium of claim 33, furthercomprising identifying the user based upon a unique identifier.
 39. Thecomputer-readable medium of claim 38, wherein the unique identifier is aserial number.
 40. The computer-readable medium of claim 38, furthercomprising tailoring a presentation of musical pieces to the user basedupon the unique identifier.
 41. The computer-readable medium of claim38, further comprising storing a user key.
 42. The computer-readablemedium of claim 41, further comprising: encrypting the audio filetransmitted the the computing device of the user with an audio file keyassociated with the audio file; and encrypting the audio file key withthe user key for the user.
 43. The computer-readable medium of claim 42,further comprising: decrypting the audio file key that is encrypted withthe user key using the stored user key; and decrypting the audio filewith the decrypted audio file key.
 44. The computer-readable medium ofclaim 33, wherein the musical instrument is a microphone.
 45. Thecomputer-readable medium of claim 33, wherein the musical instrument isa guitar.
 46. The computer-readable medium of claim 45, wherein themultimedia data of the session file sets the control panel graphicalinterface to pre-defined values to model the sound characteristics ofthe guitar associated with the audio file for the musical piece selectedby the user.
 47. The computer-readable medium of claim 46, furthercomprising removing a guitar track from the audio file for the musicalpiece selected by the user such that the user can play the user's guitarin conjunction with a multimedia presentation of the audio file thatdoes not include the guitar track.
 48. The computer-readable medium ofclaim 46, further comprising displaying music notation for a guitarassociated with the audio file of the musical piece selected by the userin the multimedia presentation to the user.